ST: Prompting Strategies — Structure Note

A Structure Note (ST) is a lightweight MOC inside the Zettelkasten. It groups permanent notes on a single theme without duplicating their content.

Theme: How do different prompting strategies affect LLM performance on PM tasks?


Core Claims (linked permanent notes)

Cluster Summary

Six interconnected claims about how prompting strategy choice affects LLM performance and reproducibility in PM tasks.

  1. CoT improves structured classificationPN-CoT-FewShot-Prompting
  2. Few-shot k has non-monotonic effect on MAEPN-CoT-FewShot-Prompting
  3. Local LLMs trade capability for reproducibilityPN-LLM-Local-vs-Cloud
  4. RCOIF structures AI prompts for research tasksPN-RCOIF-Framework
  5. EGI maps unfamiliar domains iterativelyPN-EGI-Framework
  6. AMI enables iterative self-improvementPN-AMI-DRCA-IIPR-Frameworks

PUMA Experiment Connection

The four prompting strategies evaluated in Stage 1 and Stage 2:

StrategyCodeLiterature basis
Zero-ShotS1Brown et al. 2020
Few-Shot-3S2Tawosi et al. 2024 (CoGEE)
Few-Shot-6S3Calikli & Alhamed 2025
Chain-of-ThoughtS4Wei et al. 2022

EX-Hypotheses-H1-H2EX-Stages-OverviewPT-PUMA-Experiment-PromptsLN-Calikli-2025-RequestFormats — non-monotonic k effect → LN-Datasets-JiraSR-TAWOS — evaluation datasets → PN-IssueTriage-StoryPoints — PUMA tasks measured → MOC-Methods-Frameworks — All prompting methods