In den Nachrichten
Pass the Baton: Trajectory-Relayed On-Policy Distillation
arXiv cs.AI · Veröffentlicht am · 3 Min. Lesezeit
In 30 Sekunden
- Was passiert ist
- Relay-OPD improves student model training by having a teacher model take over when the student commits to wrong reasoning directions, then resuming student training on corrected trajectories.
- Warum es zählt
- Matters for engineers training smaller language models on reasoning tasks who want better performance with less compute spent on misdirected generations.
- Achtung
- Method requires detecting failure points and managing teacher intervention budget; unclear how well trigger detection generalizes across different model sizes and task domains.
Diese Zusammenfassung anhören
Aus dem Artikel
-->
Computer Science > Computation and Language
arXiv:2607.26057v1 (cs)
[Submitted on 28 Jul 2026]
Title: Pass the Baton: Trajectory-Relayed On-Policy Distillation
Authors: Haolei Xu , Xiaowen Xu , Haiwen Hong , Zixuan Ni , Hongxing Li , Yiwen Qiu , Weiming Lu , Yongliang Shen
View a PDF of the paper titled Pass the Baton: Trajectory-Relayed On-Policy Distillation, by Haolei Xu and 7 other authors
View PDF HTML (experimental)
Abstract: On-policy distillation (OPD) grounds token-level supervision in the student's own trajectory, yet suffers from prefix failure: once the student commits to a wrong reasoning direction, all subsequent generation builds on this deviation, producing misdirected continuations that elicit unreliable supervision and waste compute. We identify a teacher-student continuation asymmetry on failed prefixes, where the teacher tends to redirect while the student continues along the original direction, and convert it into a label-free handoff trigger in Relay On-Policy Distillation (Relay-OPD). During training, Relay-OPD constructs relay trajectories by letting the teacher briefly take over at detected trigger points to produce a teacher leg, after which the student resumes and is optimized on the resulting trajectory. A limited relay budget concentrates intervention on critical early positions while limiting departure from the student policy. With a Qw
Auszug aus dem Original. Den vollständigen Text bei der Quelle lesen.
Den vollständigen Artikel lesen
- reasoning
The Agent Architect
Ein Pattern, ein Tradeoff, eine Produktionspanne. Ein kurzes wöchentliches Briefing für alle, die agentische Systeme bauen.
Wöchentliche E-Mail, Abmeldung mit einem Klick. Ihre Adresse wird nur für das Briefing verwendet.