Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation
Bingxi Hou, Guochao Jiang, Guofeng Quan +4 authors
Waypoint-OPD improves policy-shift distillation by gating endpoint shifts using directional agreement between early and late teacher policy changes, boosting reasoning performance with minimal overhead.