nano-gpt-data-curation
gpt-5.6-sol
nano-gpt-data-curation — graded by the task's verifier against a measured baseline.
- backend
- modal
- variant
- codex azure_ai/gpt-5.6-sol
- metric
- held-out multi-domain perplexity
- actions
- 285
- duration
- 1h 22m
- recorded
- 2026-08-04
run iddclm-nano-curation__NqS7udZ
Score
reward
329.480
Summary
Completed all deliverables:
- selection.json — 143,021 unique valid IDs; exact 12M-token coverage verified.
- curate.py — reproducible contrastive, domain-balanced curation.
- claim.md — hypothesis, mechanism, falsification, and transfer.
Frozen dev evaluation: 310.448 perplexity, versus 448.217 for random selection. Estimated selected-prefix domain shares are 25% each.