Research Tools — Academic Discovery & Management

Overview

Overview of all research tools used in the PUMA literature review pipeline (F0 Initiation).


🔍 Search & Discovery

Google Scholar

  • URL: scholar.google.com
  • Best for: Broad coverage, citation counts, related articles
  • PUMA use: Initial broad search, finding seminal papers
  • Search tip: Use "LLM" "project management" "benchmark" after:2022

arXiv

  • URL: arxiv.org (cs.SE, cs.AI, cs.LG)
  • Best for: Preprints, latest research (often 6-12 months ahead of conferences)
  • PUMA use: Finding cutting-edge papers not yet in IEEE/ACM
  • Search tip: ti:LLM AND ti:benchmark AND ti:"software engineering"

Semantic Scholar

  • URL: semanticscholar.org
  • Best for: Semantic search, paper recommendations, citation graphs, free API
  • PUMA use: Finding papers similar to CoGEE, TAWOS papers
  • API: https://api.semanticscholar.org/graph/v1/paper/search

IEEE Xplore

  • URL: ieeexplore.ieee.org
  • Best for: Conference papers (ICSE, MSR, ICSME, SANER)
  • PUMA use: Finding empirical SE papers with rigorous methodology

ACM Digital Library

  • URL: dl.acm.org
  • Best for: ACM conferences (FSE, ISSTA, ASE, ESEC)
  • PUMA use: Accessing CoGEE (EASE 2024) and related papers

ResearchGate

  • URL: researchgate.net
  • Best for: Requesting full-text from authors, finding grey literature
  • PUMA use: When papers are behind paywalls

Anna’s Archive

  • URL: annas-archive.org
  • Best for: Accessing books and papers unavailable elsewhere
  • PUMA use: Accessing textbooks (Flyvbjerg & Gardner, Wohlin et al.)

O’Reilly Online Learning

  • URL: learning.oreilly.com
  • Best for: Technical books, hands-on guides
  • PUMA use: LLM engineering books, Python data science references

🤖 AI-Assisted Research Tools

Perplexity AI

  • URL: perplexity.ai
  • Model: Sonar (web-grounded)
  • Best for: Current state-of-the-art queries, quick paper discovery with citations
  • PUMA use: F0 panoramic mapping of PM+LLM landscape
  • Key prompt: 60 - Resources/61 Prompts/61.2 Research-Tools/PT-Perplexity-State-of-Art
  • ⚠️ Validation rule: Every citation from Perplexity MUST be verified in primary source before use

Perplexity Comet

  • Best for: Deeper research with more web sources
  • PUMA use: Finding reproducibility statistics for LLM SE papers

Consensus

  • URL: consensus.app
  • Best for: Evidence-based questions (“Does few-shot prompting improve classification?“)
  • PUMA use: Validating assumptions about CoT and few-shot effectiveness
  • Key prompt: 60 - Resources/61 Prompts/61.2 Research-Tools/PT-Consensus-Evidence

Elicit

  • URL: elicit.com
  • Best for: SLR screening, structured paper analysis, data extraction
  • PUMA use: PRISMA abstract screening, extracting metrics from papers
  • Key prompt: 60 - Resources/61 Prompts/61.2 Research-Tools/PT-Elicit-SLR-Screening

🕸️ Citation Network Tools

Connected Papers

  • URL: connectedpapers.com
  • Best for: Visual citation network, finding related papers in graph form
  • PUMA use: Starting from CoGEE → find adjacent benchmark papers

Research Rabbit

  • URL: researchrabbitapp.com
  • Best for: Collection management, “more like this”, author networks
  • PUMA use: Building the PUMA paper collection iteratively

Litmaps

  • URL: litmaps.com
  • Best for: Citation timeline visualization, identifying seminal papers
  • PUMA use: Mapping the evolution of PM+LLM research 2019–2026

📚 Reference Management

Zotero

  • URL: zotero.org
  • PUMA use: Primary reference manager for all 40+ papers
  • Key features used:
    • Group library: “PUMA-Project”
    • Tags: #puma-include, #puma-exclude, #puma-pending, #seminal, #dataset
    • Better BibTeX plugin for APA 7th export
    • Zotero → Obsidian integration via citation plugin
  • Organisation strategy: 60 - Resources/61 Prompts/61.2 Research-Tools/PT-Zotero-Organisation

Mendeley

  • URL: mendeley.com
  • PUMA use: Secondary backup, PDF annotation when Zotero unavailable

📝 Knowledge Base Tools

NotebookLM (Google)

  • URL: notebooklm.google.com
  • Best for: Multi-paper knowledge base, Q&A over uploaded PDFs
  • PUMA use: Upload core 10-15 papers, query for cross-paper synthesis
  • ⚠️ Validation rule: Every relationship NotebookLM identifies must be verified in source papers
  • Key prompt: 60 - Resources/61 Prompts/61.1 LLM-Tools/PT-NotebookLM-Paper-Corpus

AnythingLLM

  • URL: anythingllm.com (local deployment)
  • Best for: Local RAG over personal document collection
  • PUMA use: Local knowledge base with Qdrant or ChromaDB backend
  • Key prompt: 60 - Resources/61 Prompts/61.1 LLM-Tools/PT-AnythingLLM-Local-RAG

60 - Resources/61 Prompts/61.2 Research-Tools/PT-AcademicDB-Search-Strings WF-SLR-Pipeline PN-DSR-SLR-Methods