Skip to content
on-policy-self-distillation

gpt-5.6-sol

on-policy-self-distillation — graded by the task's verifier against a measured baseline.

backend
modal
variant
codex azure_ai/gpt-5.6-sol
metric
AIME24 avg@12 accuracy
actions
596
duration
7h 59m
recorded
2026-08-03

run idopsd-aime24-4gpus__kuc95M7

Score

reward
55.222
task baseline
56.33 ± 1.6
compare against every run on this task →

Summary

Implemented normalized front-loaded OPSD credit assignment in opsd_trainer.py.

  • Token weights decay linearly from 1.5 to 0.5 across each rollout.
  • Mean weight remains exactly 1, preserving loss scale and budget.
  • Two independent full dev runs scored 56.11% versus the 54.22% baseline: +1.89 points.
  • recipe.env has no active overrides.
  • Syntax, weighting invariants, and gradient checks pass.
  • Pre-existing README changes were untouched.

Transcript