Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Tencent Robotics X, HY Vision Team, Xumin Yu +19 authors
HY-Embodied-0.5 is a foundation model family for embodied agents featuring Mixture-of-Transformers architecture and iterative post-training for enhanced visual perception and reasoning capabilities.
Chenxu Yang, Chuanyu Qin, Qingyi Si +7 authors
RLSD combines reinforcement learning with verifiable rewards and self-distillation to achieve stable training with fine-grained updates and reliable policy direction from environmental feedback.
Yi Ding, Ruqi Zhang
On-policy distillation relies mainly on suppressing low-probability tokens rather than teacher guidance, motivating a supervision-free entropy-adaptive method that substantially improves reasoning performance.
Xinlei Yu, Gen Li, Qingyi Si +13 authors
DOPD addresses privilege illusion in on-policy distillation by dynamically routing token-level supervision between teacher and student policies based on advantage gaps and probabilities, improving capability transfer in large and vision-language models.
Yaxuan Li, Yuxin Zuo, Bingxiang He +8 authors
On-policy distillation dynamics in large language models depend on compatible thinking patterns between teacher and student models, with successful distillation characterized by alignment on high-probability tokens and requiring teachers to provide novel capabilities beyond student training data.
Jinyang Wu, Shuo Yang, Zhengxi Lu +8 authors
SEED improves long-horizon agent training by extracting hindsight skills from completed trajectories and distilling them into dense token-level supervision alongside outcome-based reinforcement learning.
Yuchao Gu, Guian Fang, Yuxin Jiang +4 authors
AnyFlow introduces a novel any-step video diffusion distillation framework that improves upon consistency distillation by optimizing full ODE sampling trajectories through flow-map transition learning and backward simulation techniques.
Zhen Fang, Wenxuan Huang, Yu Zeng +8 authors
Flow-OPD addresses limitations in Flow Matching text-to-image models through a two-stage alignment approach combining on-policy distillation and manifold anchor regularization, achieving significant improvements in generation quality and alignment metrics.
Zixuan Fu, Bingxiang He, Yuxin Zuo +10 authors
On-policy distillation improves over hundreds of steps from a single query by rapidly covering teacher states, yet student alignment remains slow, indicating the method is algorithm-starved rather than data-starved.
Bingnan Li, Haozhe Wang, Haozhong Xiong +5 authors
On-policy diffusion distillation under classifier-free guidance suffers from branch-level error compensation, which is resolved by separately matching positive predictions and guidance directions.
Zhennan Shen, Yanshu Li, Qingyu Yin +6 authors
On-policy distillation exhibits distinct parameter space dynamics characterized by relaxed off-principal updates and subspace locking, forming a unique geometric pattern separate from supervised fine-tuning and reinforcement learning with verifiable rewards.
Lei Bai, Jiaqi Cao, Chiyu Chen +122 authors
Intern-S2-Preview is a scientific agentic foundation model series that integrates multimodal pre-training, multi-task reinforcement learning, and memory-augmented extensions to support long-horizon scientific reasoning and forecasting.
Wenkai Yang, Weijie Liu, Ruobing Xie +3 authors
On-policy distillation is extended through a generalized framework that introduces flexible reference models and reward scaling factors, demonstrating improved performance through reward extrapolation and reward correction techniques.
Ethan Chern, Zhulin Hu, Bohao Tang +4 authors
Real-time multimodal video generation via diffusion is enabled by an improved distillation approach with multimodal conditioning and optimized scheduling, reducing inference latency while maintaining quality for interactive systems.
RadixArk, Tom Chen, Mao Cheng +10 authors
Miles is an open-source, production-ready system for large-scale reinforcement learning and post-training that supports diverse backends, weight synchronization, LoRA, distillation, and diffusion models.
Run Yang, Runpeng Dai, Jie Sun +5 authors
Influence-Directed Adaptive On-Policy Distillation improves diversity transfer in reasoning model distillation by selectively preserving entropy-expanding updates and replacing entropy-contracting ones with adaptive advantage shrinkage.
Peixuan Han, Runhui Wang, Ketan Ramaneti +3 authors
Cliff improves reinforcement learning with verifiable rewards by using an off-the-shelf language model to detect the first reasoning error and shaping token-level advantages accordingly.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号