PUMA Vault
Search
Buscar
Modo oscuro
Modo claro
Explorador
Etiqueta: mae
30 artículos con esta etiqueta.
15 jun 2026
LN-Tools — Reproducibility is enforced by puma validate-baseline, which re-runs a…
literature-tools
puma
engine
mae
reproducibility
baseline
release
15 jun 2026
Evaluation Metrics — Comprehensive Reference for PUMA
permanent
evaluation
metrics
f1
mae
rmse
spearman
wilcoxon
auc-roc
bleu
rouge
perplexity
co2
inference-latency
puma-core
research
benchmark
statistics
story-points
issue-triage
effort-estimation
statistical-validation
nlp
sustainability
15 jun 2026
PN — A transferable lesson: on a long-tailed story-point distribution, the…
permanent-note
puma
methodology
mae
baseline
15 jun 2026
PN — H2 (estimation): best config qwen2.5:7b cuts MAE only 0.17 SP vs a…
permanent-note
puma
engine
estimation
mae
baseline
15 jun 2026
PN — MAE (mean absolute error in story points) is the primary effort-estimation…
permanent-note
puma
reference
estimation
story-points
mae
15 jun 2026
PN — H2 (estimation): the null states no example-enriched configuration beats…
permanent-note
puma
methodology
estimation
story-points
mae
wilcoxon
15 jun 2026
PN — The experiment is a reduced factorial design with two main independent…
permanent-note
puma
methodology
mae
reproducibility
sustainability
prompting
15 jun 2026
PN — Estimation maps user stories to a canonical Fibonacci story-point value…
permanent-note
puma
methodology
estimation
mae
media
15 jun 2026
PN — PUMA reports a multi-dimensional metric suite
permanent-note
puma
engine
f1-macro
mae
calibration
latency
15 jun 2026
PN — Sustainability is reported per run via CodeCarbon (CO2 kg, energy kWh,…
permanent-note
puma
engine
mae
sustainability
carbon
codecarbon
15 jun 2026
PN — PUMA treats inference compute cost as a first-class reported metric…
permanent-note
puma
engine
mae
carbon
15 jun 2026
RES — The best estimation configuration achieves MAE=1.86 SP (7B model,…
result-note
puma
methodology
estimation
mae
contextual-anchoring
zero-shot
15 jun 2026
RES — H2 is NOT REJECTED: the best estimation config (7B, MAE=1.86 SP) does not…
result-note
puma
methodology
estimation
mae
wilcoxon
baseline
15 jun 2026
RES — All five MVP acceptance criteria are met comfortably (F1-macro, MAE,…
result-note
puma
methodology
f1-macro
mae
reproducibility
hypothesis
15 jun 2026
RES — Three consecutive warm-state runs of the canonical config produce…
result-note
puma
methodology
f1-macro
mae
reproducibility
latency
15 jun 2026
RES — The empirical answer to the research question is asymmetric
result-note
puma
methodology
triage
estimation
mae
15 jun 2026
RES — The canonical estimation baseline is MAE = 5.7150 SP (qwen2.5:3b,…
result-note
puma
engine
estimation
mae
zero-shot
baseline
15 jun 2026
RES — The best reproducible estimation configuration observed is qwen2.5:7b at…
result-note
puma
engine
estimation
story-points
mae
sweep
15 jun 2026
RES — No single model wins across all PMO tasks
result-note
puma
engine
triage
estimation
mae
15 jun 2026
RES — Cross-architecture (x86_64 vs arm64 Apple Silicon) bit-exactness of F1/MAE…
result-note
puma
engine
mae
architecture
15 jun 2026
RES — PUMA empirical results (canonical index)
result
puma
benchmark
f1-macro
mae
sustainability
15 jun 2026
DEC — MVP acceptance is quantitative, verified at end of stage 2
decision-note
puma
methodology
f1-macro
mae
reproducibility
baseline
15 jun 2026
DEC — A triage run between an Ollama restart and an estimation validation…
decision-note
puma
engine
triage
estimation
mae
ollama
15 jun 2026
DEBT — D29 (deferred to Horizon H5): the estimation prediction-hash is…
decision-note
puma
reference
estimation
mae
15 jun 2026
ARCH — Key scientific result figures are exported via puma generate-plots (PDF…
artifact-note
puma
reference
triage
f1-macro
mae
tawos
15 jun 2026
ARCH — The estimation_tawos scenario predicts story points as a Fibonacci value…
artifact-note
puma
engine
estimation
story-points
mae
tawos
15 jun 2026
ARCH — The estimation scenario uses a cleaned 9,020-row TAWOS dataset (SOLAR…
artifact-note
puma
engine
estimation
story-points
mae
dataset
15 jun 2026
REPO — Submission scenarios are triage_jira (F1-macro/accuracy), effort_tawos…
artifact-note
puma
community
triage
f1-macro
mae
rcoif
15 jun 2026
REPO — The leaderboard ranks quality vs environmental cost
artifact-note
puma
community
triage
f1-macro
mae
leaderboard
15 jun 2026
PH — The two benchmark tasks and datasets were locked
decision-note
puma
project-history
triage
estimation
f1-macro
mae