Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho +3 authors
A study on Self-Rewarding Language Models shows that using LLM-as-a-Judge prompting for iterative DPO training enhances both instruction-following and self-reward generation, leading to superior performance compared to existing systems.
Kiran Kamble, Melisa Russak, Dmytro Mozolevskyi +3 authors
FailSafeQA evaluates the robustness and context-awareness of large language models in financial applications through domain expertise, query completeness, linguistic accuracy, and document relevance challenges.
Zhenru Zhang, Chujie Zheng, Yangzhen Wu +6 authors
Process Reward Models improve performance in mathematical reasoning by integrating Monte Carlo estimation with LLM-as-a-judge, addressing biases in Best-of-N evaluation and step-wise error identification.
Prateek Chhikara, Dev Khant, Saket Aryan +2 authors
Mem0, a memory-centric architecture with graph-based memory, enhances long-term conversational coherence in LLMs by efficiently extracting, consolidating, and retrieving information, outperforming existing memory systems in terms of accuracy and computational efficiency.
Viraat Aryabumi, Yixuan Su, Raymond Ma +6 authors
The inclusion of code data during pre-training significantly improves LLMs' performance across various natural language and world knowledge tasks, beyond code generation.
Lianmin Zheng, Wei-Lin Chiang, Ying Sheng +10 authors
Using strong large language models as judges for evaluating other LLM-based chat assistants achieves high agreement with human preferences, offering a scalable and explainable solution compared to traditional benchmarks.
Haoran Que, Feiyu Duan, Liqun He +11 authors
A comprehensive benchmark, HelloBench, and evaluation method, HelloEval, are introduced to assess the long text generation capabilities of Large Language Models, revealing limitations and providing human-aligned evaluations.
Dawei Li, Bohan Jiang, Liangjie Huang +10 authors
A survey of LLM-based judgment and assessment explores definitions, taxonomy, benchmarks, challenges, and future directions for the LLM-as-a-judge paradigm.
Aman Singh Thakur, Kartik Choudhary, Venkat Srinik Ramayapally +2 authors
LLM-as-a-judge method for evaluating LLMs shows promise but varies in performance and alignment with human judges, with smaller models like JudgeLM-7B sometimes outperforming larger ones in ranking tasks.
Jaewoo Ahn, Junseo Kim, Hyunseo Kim +4 authors
MineAmongUs introduces a 3D multimodal Among Us environment and the ARIA harness to study embodied VLM-agent deception through verbal and non-verbal actions, revealing non-verbal channels as key to winning.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号