Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma +8 authors
Branch-Train-MiX (BTX) method enhances Large Language Models by asynchronously training experts in parallel and integrating them using Mixture-of-Expert layers with token-level routing for improved accuracy and efficiency.
Xiwei Hu, Rui Wang, Yixiao Fang +3 authors
ELLA, an Efficient Large Language Model Adapter, enhances text-to-image diffusion models by integrating powerful Large Language Models through a Timestep-Aware Semantic Connector, improving dense prompt comprehension and generation quality.
Wei He, Kai Han, Hang Zhou +4 authors
ROOT, a robust optimizer, enhances training stability and convergence for large language models by addressing dimensional fragility and outlier noise through adaptive Newton iterations and proximal optimization.
Fanqing Meng, Jiaqi Liao, Xinyu Tan +7 authors
PhyGenBench and PhyGenEval assess text-to-video models' understanding of physical commonsense, revealing shortcomings that cannot be fully addressed by scaling models or prompt engineering.
Yinghao Ma, Anders Øland, Anton Ragni +40 authors
A review of foundation models in music, including large language models and latent diffusion models, highlights their impact, architectural choices, and the need for ethical considerations in music applications.
Mo Li, Songyang Zhang, Yunxin Liu +1 authors
NeedleBench and the Ancestral Trace Challenge evaluate the long-context retrieval and reasoning capabilities of large language models, highlighting their limitations in practical applications.
Yupeng Chang, Xu Wang, Jindong Wang +13 authors
A comprehensive review of evaluation methods for large language models (LLMs) focusing on tasks, methods, and future challenges.
Dongseong Hwang, Weiran Wang, Zhuoyuan Huo +2 authors
Feedback Attention Memory (FAM) enhances Transformer architecture by enabling long-context processing without additional weights, significantly improving performance on large sequences across various model sizes.
Zehui Chen, Kuikun Liu, Qiuchen Wang +4 authors
MindSearch, an LLM-based multi-agent framework, improves web information seeking and integration through parallel processing and hierarchical retrieval, achieving better performance than existing solutions.
Roee Hendel, Mor Geva, Amir Globerson
In-Context Learning in Large Language Models can be understood as compressing a training set into a task vector that modulates a transformer for output generation.
Wangchunshu Zhou, Yuchen Eleanor Jiang, Long Li +14 authors
Agents is an open-source library that facilitates the creation, customization, and deployment of autonomous language agents with features like planning, memory, and tool usage, aiming to make advances in large language models accessible to a broader audience.
Noveen Sachdeva, Benjamin Coleman, Wang-Cheng Kang +6 authors
Data-efficient methods like Ask-LLM and Density sampling improve model quality and training efficiency in large language models by optimizing data selection and coverage.
Yunhao Fang, Ligeng Zhu, Yao Lu +6 authors
A novel data augmentation approach iteratively improves visual language model data quality and performance using self-augmentation and specialist-augmentation, leading to state-of-the-art results on MMMU tasks.
Young-Jun Lee, Seungone Kim, Minki Kang +5 authors
Evolutionary fine-tuning enables large language models to develop cross-task problem-solving capabilities by learning from search trajectories, demonstrating improved performance on mathematical conjectures and optimization tasks.
Linzheng Chai, Shukai Liu, Jian Yang +15 authors
A multilingual code benchmark covering 40 programming languages with 16K test samples is introduced to advance code language model research, along with a multilingual coder model and instruction corpora.
Haoran Que, Feiyu Duan, Liqun He +11 authors
A comprehensive benchmark, HelloBench, and evaluation method, HelloEval, are introduced to assess the long text generation capabilities of Large Language Models, revealing limitations and providing human-aligned evaluations.
Wei-Lin Chiang, Lianmin Zheng, Ying Sheng +8 authors
Chatbot Arena, an open platform, evaluates LLMs based on human preferences using pairwise comparisons and crowdsourced votes, confirming its credibility through diverse and accurate data analysis.
Dahyun Kim, Yungi Kim, Wonho Song +4 authors
A stepwise direct preference optimization approach improves the alignment of large language models with human preferences and enhances their performance.
Kai Chen, Yunhao Gou, Runhui Huang +27 authors
EMOVA integrates speech, vision, and language capabilities, achieving top performance in benchmarks and enabling emotive spoken dialogue using a disentangled speech tokenizer and style module.
Lingyun Zhang, Bin jin, Gaojian Ge +7 authors
A principle for leveraging human priors in data construction is proposed to improve small language models, demonstrating favorable performance on large benchmarks in resource-constrained settings.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号