Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Pierre Colombo, Telmo Pires, Malik Boudiaf +7 authors
Two large legal language models, SaulLM-54B and SaulLM-141B, based on the Mixtral architecture, are introduced for domain-specific adaptation in the legal sector using continued pretraining, specialized protocols, and preference alignment with synthetic data.
Liqiang Jing, Zhehui Huang, Xiaoyang Wang +6 authors
DSBench evaluates large language and vision-language models on realistic data science tasks, revealing significant performance gaps that indicate the need for improved autonomous agents.
Xun Liang, Hanyu Wang, Huayi Lai +7 authors
Sparse Expert Activation Pruning (SEAP) is a method for pruning large language models that reduces computational overhead while maintaining accuracy by identifying and retaining task-specific expert activations.
Chunqiu Steven Xia, Yinlin Deng, Soren Dunn +1 authors
Agentless, a two-phase approach to software development automation, achieves high performance and low cost compared to complex autonomous agents on the SWE-bench Lite benchmark.
Xun Liang, Hanyu Wang, Yezhaohui Wang +8 authors
Controllable Text Generation techniques for Large Language Models ensure predefined control conditions and high-quality text output, covering content and attribute control through various methods like retraining, fine-tuning, and latent manipulation.
Xin Men, Mingyu Xu, Qingyu Zhang +5 authors
A new layer pruning method called ShortGPT significantly improves model pruning performance by removing redundant layers based on Block Influence scores.
King Zhu, Hanhao Li, Siwei Wu +12 authors
Systematic exploration of test-time scaling methods in large language agents reveals that computational scaling improves performance, especially through parallel sampling, sequential revision, effective verification, and increased rollout diversity.
Guilong Lu, Xuntao Guo, Rongjunchen Zhang +2 authors
BizFinBench is a benchmark for evaluating large language models in financial applications, revealing distinct performance patterns across various tasks.
Doohyuk Jang, Yoonjeon Kim, Chanjae Park +2 authors
A diagnostic set examines and categorizes reasoning rigidity in large language models, identifying patterns where models ignore instructions and default to familiar reasoning.
Ming Li, Yanhong Li, Tianyi Zhou
Investigating gradient patterns in LLMs during fast vs. slow training reveals that slow thinking (chain-of-thoughts) enhances learning stability and distinguishes correct reasoning paths.
Zeyi Sun, Ziyang Chu, Pan Zhang +6 authors
X-Prompt, an auto-regressive large-vision language model, uses in-context learning to achieve competitive performance in seen and unseen image generation tasks.
Nikhil Kandpal, Brian Lester, Colin Raffel +24 authors
The Common Pile v0.1 dataset, an 8-terabyte collection of openly licensed text, is used to train competitive 7 billion parameter LLMs.
Zhenting Wang, Qi Chang, Hemani Patel +8 authors
MCP-Bench evaluates large language models on complex, multi-step tasks requiring tool use, coordination, and planning across various domains.
Dacheng Li, Shiyi Cao, Chengkun Cao +6 authors
A hybrid test-time scaling framework improves code generation coverage and accuracy across various models and domains.
Ganqu Cui, Lifan Yuan, Zefan Wang +20 authors
PRIME leverages implicit process rewards to improve the reinforcement learning of large language models, achieving better performance with less data compared to traditional methods.
Ethem Yağız Çalık, Talha Rüzgar Akkuş
Advancements in enhancing natural language understanding, conversational coherence, and emotional intelligence in large language models improve user interactions and expand AI applications, while future research will address ethical implications and biases.
Corby Rosset, Ching-An Cheng, Arindam Mitra +3 authors
A Direct Nash Optimization (DNO) algorithm is introduced for post-training large language models using preference feedback, achieving state-of-the-art performance with polynomial parameters.
Gleb Mezentsev, Ivan Oseledets
LLMs can generate long text segments in a single forward pass using learned embeddings, revealing a capability for multi-token generation without iterative decoding.
Yue Wang, Qiuzhi Liu, Jiahao Xu +11 authors
A new decoding strategy addresses underthinking in large language models by penalizing frequent thought switching, improving accuracy without fine-tuning.
Chris Yuhao Liu, Liang Zeng, Yuzhen Xiao +9 authors
Skywork-Reward-V2, a suite of reward models trained on a large-scale, high-quality preference dataset, achieves state-of-the-art performance across various benchmarks by leveraging human-AI synergistic curation.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号