LN: Flyvbjerg (2023) — The Uniqueness Trap: How Project Management Resists Learning

Bibliographic Reference

Citation: Flyvbjerg, B. (2023). The uniqueness trap: How project management resists learning. ResearchGate. https://www.researchgate.net/publication/389396526_The_Uniqueness_Trap Related work: Flyvbjerg, B. (2014). What you should know about megaprojects and why. Project Management Journal, 45(2), 6–19. https://doi.org/10.1002/pmj.21409


Pass 1 — Bird’s Eye View (5 Cs)

CAssessment
CategoryTheoretical critique + evidence-based argument
ContextBuilds on Flyvbjerg’s decades of megaproject research; extends the reference class forecasting argument to general PM practice
CorrectnessSupported by empirical data on project overruns across industries (IT, construction, defence)
Contributions(1) Names “uniqueness trap” as a cognitive bias in PM; (2) Argues that treating projects as unique prevents accumulation of reusable knowledge; (3) Advocates for reference class forecasting as the evidence-based alternative
ClarityExcellent. Accessible writing, concrete examples, strong argument.

Relevance: ⭐⭐⭐⭐⭐

The uniqueness trap is the theoretical motivation for PUMA — automated agents can overcome this bias by applying reference class patterns (historical issue data) systematically to new issues.


Pass 2 — Content

The Uniqueness Trap Defined

Core Argument

Project managers systematically treat each project as unique — a “special case” — and therefore discard historical data when making estimates. This is a cognitive bias that causes systematic cost overruns and schedule delays. Flyvbjerg calls this the Uniqueness Trap.

The trap operates at two levels:

  1. Inside view: Focus on the specifics of the current project; generate estimates from first principles
  2. Outside view (neglected): Look at similar past projects; use the statistical distribution of outcomes as the base rate

Kahneman & Tversky’s planning fallacy (2003) describes the same phenomenon at the individual level. Flyvbjerg extends it to organizational PM culture.

Empirical Evidence

From Flyvbjerg’s database of 16,000+ projects across 20 countries and 5 decades:

  • IT projects: Average cost overrun 27%; 18% are “black swans” (>50% overrun)
  • Large IT projects: Average overrun 66%; 27% are black swans
  • Construction: Similar patterns persist despite lessons-learned programs

Reference Class Forecasting (RCF) — The Solution

RCF (Kahneman-Lovallo, 2003; Flyvbjerg, 2008) as the antidote:

  1. Select a reference class of similar past projects
  2. Build the statistical distribution of outcomes (cost, duration)
  3. Predict where the current project will land in that distribution
  4. Adjust for specific information about the current project

This is exactly what LLM-based agents can do systematically: use historical Jira issue data as the reference class for effort estimation.


Pass 3 — Virtual Reconstruction

Q1 (How does PUMA overcome the uniqueness trap?): PUMA’s H2 (effort estimation) directly attacks the uniqueness trap. A Few-shot LLM agent encodes the reference class (3–6 historical issues) explicitly in the prompt. The agent provides the “outside view” that human estimators resist using.

Q2 (Is the uniqueness trap real in software PM?): Yes — extensive empirical support from Jain (2002), Capers Jones (2008), and the Standish CHAOS Report series. The TAWOS dataset itself demonstrates systematic patterns in issue types and story point distributions that contradict the “each issue is unique” assumption.

Q3 (What does this mean for PUMA’s framing?): PUMA is positioned as a reference class forecasting tool for PM — not as a magic predictor, but as a systematic application of the outside view to issue classification and effort estimation.


PUMA Integration

  • Ch.1 Introduction: The uniqueness trap is the motivating problem PUMA solves — insert as the opening argument
  • H2 Framing: PUMA’s few-shot CoT for estimation = automated reference class forecasting
  • Ch.5 Discussion: Explain that PUMA’s systematic approach is more reliable than human intuition because it doesn’t fall into the uniqueness trap
  • Related person note: PER-Flyvbjerg-Bent

Permanent Notes Generated

MOCs