π¬ Research Pipeline Map of Content
Overview
This MOC maps the complete research methodology pipeline used in PUMA, combining three integrated frameworks.
Framework 1 β Evidence-Based Research Augmented by AI (EBSE + PRISMA-trAIce)
Phase 0: Problem Definition
βββ FINER criteria validation
βββ Research question formulation
βββ Falsifiable hypotheses (Popper)
β
Phase 1: Systematic Literature Review (SLR)
βββ PRISMA 2020 protocol
βββ PRISMA-DFLLM extension (AI-assisted screening)
βββ PRISMA-trAIce (AI use documentation)
β
Phase 2: Gap Analysis
βββ Reproducibility gap
βββ Prompting strategy gap
βββ Carbon footprint gap
β
Phase 3: Methodological Design (DSR)
βββ Artefact specification (SDD/BDD)
βββ Experiment design
β
Phase 4: Experimentation
βββ Controlled conditions
βββ Statistical analysis (Wilcoxon)
βββ Carbon measurement (CodeCarbon)
β
Phase 5: Evaluation & Discussion
βββ H1, H2 testing
βββ Validity analysis
βββ Replicability verification
Key notes:
- PN-DSR-SLR-Methods β SLR + PRISMA protocol
- PN-Wilcoxon-FINER-Cornell-PRISMA β FINER + PRISMA details
- PRISMA-Log β Active screening log
- PR-PUMA-Ch2-Ch3-Ch4-Ch5 β SLR execution
Framework 2 β Design Science Research + SDD/BDD + AI Agents
DSR Cycle (Hevner 2004 + Peffers 2007):
Problem β Objectives β Design & Development β Demonstration β Evaluation β Communication
SDD Chain:
Spec-First Design
βββ OpenSpec format
βββ Spec Kit validation
βββ BDD scenarios (Given/When/Then)
βββ TDD test cases
β
AI-Assisted Generation
βββ Agent generates code/specs from prompts
βββ Human validates (Human-in-the-Loop)
βββ Red Teaming (rival hypotheses)
β
BMAD Workflow
βββ Brainstorm β Map β Architect β Develop
Key notes:
- PN-DSR-SLR-Methods β DSR paradigm + SLR
- PN-SDD-Framework β Spec-Driven Development + BDD + BMAD
- SP-Architecture β PUMA architecture
- SP-PUMA-Constitution β Non-negotiable principles
Framework 3 β MIT Student Method as Cognitive Operator
The MIT Student Method operates at three levels in PUMA:
| Level | Application | Tools |
|---|---|---|
| Reading/Synthesis | Cornell notes + DRCA on each paper | PN-MIT-Student-Method |
| AI Interaction | RCOIF/RCOF + EGI + AMI + IIPR patterns | PN-RCOIF-Framework |
| Red Teaming | Rival hypotheses, counter-evidence search | PN-KeyConcepts-Agents-Reproducibility-RedTeam |
Key notes:
- PN-MIT-Student-Method β Summary method (Cornell + Red Teaming)
- PN-MIT-Student-Method-Complete β Complete Q1/Q2/Q3 + Keshav integration
- SRC-MITAILab-WP316 β Original MIT AI Lab WP316 source
- SRC-Keshav-2007-HowToReadPaper β Keshav 2007 source
- PN-EGI-Framework β Guided Interactive Exploration
- PN-AMI-DRCA-IIPR-Frameworks β AMI + DRCA + IIPR
- PN-KeyConcepts-Agents-Reproducibility-RedTeam β Red Teaming practice
- WF-MIT-AILab-Reading-Workflow β Reading workflow
- WF-Research-Experiment-Routines β Experiment routines
Phase-to-Framework Mapping
| PUMA Phase | Primary Framework | MIT Student Method Role |
|---|---|---|
| F0 Initiation | EBSE/SLR | Panoramic mapping + screening |
| F1 Design | DSR + SDD | Cornell on requirements β BDD stories |
| F2 Prototype | DSR + BDD/TDD | CoT + Few-Shot for spec generation |
| F3 Extension | DSR + BMAD | IIPR + AMI for agent iteration |
| F4 Analysis | EBSE + Stats | DRCA on results |
| F5 Closure | Full integration | Red teaming conclusions |
AI Use Documentation (per PRISMA-trAIce)
TABLE tool, phase, purpose, validation
FROM "50 - Areas/51 Research"
WHERE type = "ai-use-log"
SORT phase ASC