Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Ahmet Üstün, Viraat Aryabumi, Zheng-Xin Yong +14 authors
Aya, a multilingual generative language model supporting over 50% lower-resourced languages, excels in both generative and discriminative tasks across 99 languages, and provides extensive evaluations and open-source resources.
Ge Zhang, Scott Qu, Jiaheng Liu +42 authors
MAP-Neo, a fully open-sourced bilingual LLM with 7B parameters, achieves performance comparable to existing state-of-the-art LLMs, enhancing transparency and fostering innovation in the open research community.
Rogerio Bonatti, Dan Zhao, Francesco Bonacci +8 authors
Windows Agent Arena provides a general, reproducible environment for evaluating multi-modal agent performance on Windows OS tasks, with scalability and parallelizability features.
Hadas Orgad, Michael Toker, Zorik Gekhman +4 authors
LLMs internally encode detailed truthfulness information about their outputs, which can be used to detect and predict errors but shows variability across datasets and does not always align with the final output.
Zhuoqun Li, Xuanang Chen, Haiyang Yu +7 authors
StructRAG enhances LLMs by identifying optimal structure types, reconstructing documents into these structures, and inferring answers for knowledge-intensive reasoning tasks, achieving state-of-the-art performance.
Zihan Wang, Deli Chen, Damai Dai +3 authors
Research on parameter-efficient fine-tuning for Large Language Models with Mixture-of-Experts architecture reveals that task-specific expert tuning can enhance performance and efficiency.
Zhiyong Wu, Chengcheng Han, Zichen Ding +5 authors
OS-Copilot framework enables FRIDAY, a self-improving generalist agent, to automate a wide range of computer tasks with enhanced generalization and minimal supervision.
Abhimanyu Hans, Avi Schwarzschild, Valeriia Cherepanova +5 authors
A novel LLM detector using contrasting scores from two pre-trained models achieves high accuracy in identifying machine-generated text without any training data.
Wei He, Kai Han, Hang Zhou +4 authors
ROOT, a robust optimizer, enhances training stability and convergence for large language models by addressing dimensional fragility and outlier noise through adaptive Newton iterations and proximal optimization.
Mo Li, Songyang Zhang, Yunxin Liu +1 authors
NeedleBench and the Ancestral Trace Challenge evaluate the long-context retrieval and reasoning capabilities of large language models, highlighting their limitations in practical applications.
Di Liu, Meng Chen, Baotong Lu +11 authors
RetrievalAttention is a training-free method that accelerates attention computation in Transformer-based LLMs by using attention-aware vector search to reduce retrieval costs and GPU memory usage.
Zehui Chen, Kuikun Liu, Qiuchen Wang +4 authors
MindSearch, an LLM-based multi-agent framework, improves web information seeking and integration through parallel processing and hierarchical retrieval, achieving better performance than existing solutions.
Dongseong Hwang, Weiran Wang, Zhuoyuan Huo +2 authors
Feedback Attention Memory (FAM) enhances Transformer architecture by enabling long-context processing without additional weights, significantly improving performance on large sequences across various model sizes.
Wenhao Huang, Chenghao Peng, Zhixu Li +4 authors
AutoCrawler combines LLMs with crawlers to efficiently handle diverse and changing web environments using a hierarchical HTML structure for progressive learning.
Yupeng Chang, Xu Wang, Jindong Wang +13 authors
A comprehensive review of evaluation methods for large language models (LLMs) focusing on tasks, methods, and future challenges.
Feng Li, Renrui Zhang, Hao Zhang +5 authors
LLaVA-NeXT-Interleave addresses multi-image, multi-frame, multi-view, and multi-patch scenarios in LMMs using the M4-Instruct dataset and LLaVA-Interleave Bench to achieve leading results while maintaining single-image performance.
Chi Han, Qifan Wang, Wenhan Xiong +3 authors
LM-Infinite addresses length generalization in Transformer-based LLMs using a simple $\Lambda$-shaped attention mask, achieving fluency and quality up to 32k tokens without retraining.
Yining Hong, Haoyu Zhen, Peihao Chen +4 authors
A new family of 3D-LLMs is introduced to perform 3D-related tasks by leveraging 3D point clouds and features, outperforming state-of-the-art baselines in tasks such as 3D question answering and captioning.
Eric Wallace, Kai Xiao, Reimar Leike +3 authors
A hierarchical instruction framework for LLMs increases robustness against malicious prompts by selectively prioritizing system instructions over user inputs.
Weiquan Huang, Aoqi Wu, Yifan Yang +8 authors
LLM2CLIP leverages large language models to enhance CLIP's multimodal representation learning, enabling better handling of complex image captions by fine-tuning the LLM and using contrastive learning.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号