Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Chaofan Tao, Qian Liu, Longxu Dou +5 authors
Investigating the impact of vocabulary size on the scaling of large language models reveals that larger vocabularies improve performance when considering compute budgets, and current models often use suboptimal vocabulary sizes.
Baixiang Huang, Canyu Chen, Xiongxiao Xu +2 authors
HalluEditBench benchmarks knowledge editing methods in correcting hallucinations in Large Language Models (LLMs) using a comprehensive dataset and evaluation framework.
Jon Saad-Falcon, Joe Barrow, Alexa Siu +3 authors
PDFTriage enables LLMs to retrieve context effectively from structured documents like PDFs and web pages for better document QA performance.
Haiwen Diao, Yufeng Cui, Xiaotong Li +3 authors
EVE is an encoder-free vision-language model that achieves competitive performance on multiple benchmarks using a unified decoder and extra supervision.
Hengxing Cai, Xiaochen Cai, Shuwen Yang +14 authors
Uni-SMART, a multimodal analysis model, outperforms LLMs in understanding scientific literature with diverse content and has applications in patent infringement and chart analysis.
Lianghong Guo, Yanlin Wang, Caihua Li +6 authors
A pipeline named SWE-Factory automates the creation and validation of GitHub issue resolution datasets for training and evaluating Large Language Models, using SWE-Builder for environment setup, exit-code-based grading, and automated fail2pass validation.
Chengyue Wu, Yukang Gan, Yixiao Ge +5 authors
A new post-pretraining method using expanded Transformer blocks for Large Language Models improves knowledge without catastrophic forgetting, yielding LLaMA Pro-8.3B that excels in general tasks, programming, and mathematics.
Jun Zhao, Zhihao Zhang, Qi Zhang +2 authors
A comprehensive study on transferring English-dominant LLMs to non-English languages using LLaMA demonstrates that comparable performance can be achieved with minimal pretraining data across various language capabilities and response quality metrics.
Qingyan Guo, Rui Wang, Junliang Guo +6 authors
EvoPrompt, a framework using evolutionary algorithms, automates prompt optimization for large language models, achieving better performance than human-engineered prompts.
Dongwei Jiang, Alvin Zhang, Andrew Wang +2 authors
LLMs show resistance to feedback, termed feedback friction, even under ideal conditions, and sampling-based strategies only partially mitigate this issue.
Harrison Lee, Samrat Phatale, Hassan Mansoor +5 authors
Reinforcement learning from AI feedback (RLAIF) achieves similar performance to reinforcement learning from human feedback (RLHF) in aligning large language models with human preferences, offering a scalable alternative.
Clément Christophe, Praveen K Kanithi, Tathagata Raha +2 authors
Med42-v2 enhances Llama3 with clinical data to improve performance in healthcare settings, outperforming generic models across medical benchmarks.
Haoran Li, Qingxiu Dong, Zhengyang Tang +17 authors
GLAN, a general method for instruction tuning of LLMs, uses a taxonomy of human knowledge to generate synthetic instruction data, achieving strong performance across diverse tasks without task-specific training data.
Hyungjoo Chae, Yeonghyeon Kim, Seungone Kim +8 authors
Think-and-Execute is a novel framework that enhances algorithmic reasoning in large language models by decomposing the reasoning process into task-level logic expressed as pseudocode and instance-specific execution.
Gemma Team, Thomas Mesnard, Cassidy Hardin +105 authors
Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.
Shanghaoran Quan, Jiaxi Yang, Bowen Yu +14 authors
CodeElo is a standardized code generation benchmark based on CodeForces contests, providing comprehensive evaluation of LLMs' coding abilities with reliable Elo ratings.
Liangyu Zha, Junlin Zhou, Liyao Li +22 authors
TableGPT, a fine-tuned language model with global tabular representations, enables seamless interaction and complex operations on tables via natural language and functional commands.
Yanwei Li, Yuechen Zhang, Chengyao Wang +5 authors
Mini-Gemini enhances multi-modality Vision Language Models through high-resolution visual tokens, high-quality datasets, and VLM-guided generation, achieving leading performance in zero-shot benchmarks.
Chenglei Si, Diyi Yang, Tatsunori Hashimoto
LLM-generated research ideas are perceived as more novel than those from human experts but are deemed slightly less feasible, based on blind evaluations by NLP researchers.
Sarah Gao, Andrew Kean Gao
A tool called Constellation clusters and visualizes large language models uploaded to Hugging Face using hierarchical clustering and n-gram analysis.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号