Skip to content

Publish fixed-checkpoint sensitivity results - #199

Merged
cyberuniversal merged 1 commit into
mainfrom
codex/198-fixed-checkpoint-results
Aug 2, 2026
Merged

cyberuniversal merged 1 commit into
mainfrom
codex/198-fixed-checkpoint-results

Conversation

@cyberuniversal

Copy link
Copy Markdown
Collaborator

Closes #198

Summary

  • publishes the completed issue-196 corpus-free fixed-checkpoint summary and audit;
  • adds fixed epoch 1, fixed epoch 2, and dev-selected results to the research status documents;
  • updates the manuscript abstract, methods, results, conclusion, and limitations with a compact checkpoint-policy table;
  • states the supported interpretation: checkpoint selection amplifies the effect magnitude but does not create the mixed-over-synthetic direction.

Key result

  • fixed epoch 1: F2 21.68%, F3 27.79%, gap +6.11 pp;
  • fixed epoch 2: F2 25.40%, F3 31.98%, gap +6.58 pp;
  • dev-selected: F2 21.68%, F3 31.98%, gap +10.29 pp;
  • F3 is higher in all five seeds under both fixed policies.

Validation

  • full repository suite: 316 passed, 2 optional data skips;
  • compileall, JSON parsing/consistency, anonymous identifier/credential scan, and diff checks passed;
  • Tectonic 0.16.9 build passed;
  • final PDF: 8 A4 pages, visually inspected page by page with no clipping, overlap, broken tables, or illegible content;
  • official MRL 2026 submission call rechecked: anonymized EMNLP 2025 format, 4/8 pages excluding references.

Safeguards

Publication-only work used the reviewed corpus-free aggregate. No private prediction read, Kubernetes object, GPU, model load, inference, training, metric rerun, checkpoint selection/reselection, QALB test, diagnostics, prompt/parser change, or XG occurred.

@cyberuniversal
cyberuniversal requested a review from a team as a code owner August 2, 2026 14:54
@cyberuniversal
cyberuniversal merged commit 317ce89 into main Aug 2, 2026
1 check passed
@cyberuniversal
cyberuniversal deleted the codex/198-fixed-checkpoint-results branch August 2, 2026 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Publish fixed-checkpoint sensitivity results and update manuscript

1 participant