Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Hongyuan Adam Lu, Z. L., Victor Wei +5 authors
A novel framework for improving large language model performance through textual frequency analysis, including laws, distillation, and curriculum training approaches.
Hugo Touvron, Louis Martin, Kevin Stone +65 authors
Llama 2, a series of pretrained and fine-tuned large language models, achieves superior performance in dialogue tasks compared to open-source alternatives and offers safety enhancements.
Mo Yu, Lemao Liu, Junjie Wu +5 authors
A study investigates whether large language models understand physical concepts through a grid-based task, showing that they significantly underperform compared to humans and highlighting the stochastic parrot phenomenon.
Jiawei Zhao, Zhenyu Zhang, Beidi Chen +3 authors
Gradient Low-Rank Projection (GaLore) improves memory efficiency for training large language models without sacrificing performance, enabling pre-training of 7B models on consumer GPUs.
Junbo Niu, Zheng Liu, Zhuangcheng Gu +58 authors
MinerU2.5, a 1.2B-parameter document parsing vision-language model, achieves state-of-the-art recognition accuracy with computational efficiency through a coarse-to-fine parsing strategy.
Hongyin Luo, Wei Sun
A new integer addition-based algorithm reduces energy consumption in floating point tensor multiplications with comparable precision across various tasks.
Ruihang Chu, Yefei He, Zhekai Chen +10 authors
Wan-Move enhances motion control in video generative models by integrating motion-aware features into latent space, enabling high-quality and scalable video synthesis.
Jintao Zhang, Haoxu Wang, Kai Jiang +10 authors
SLA, a trainable attention method combining sparse and linear attention, accelerates Diffusion Transformer models for video generation with minimal quality loss.
David Bensaïd, Noam Rotstein, Roy Velich +2 authors
SingLoRA, a reformulated low-rank adaptation method, enhances parameter-efficient fine-tuning by learning a single low-rank matrix and its transpose, ensuring stable optimization and reducing parameter count.
Junying Chen, Zhenyang Cai, Ke Ji +5 authors
The proposed approach enhances medical reasoning in large language models using verifiable problems, guided search, and reinforcement learning to achieve superior performance in medical problem-solving.
Yujia Qin, Shihao Liang, Yining Ye +15 authors
ToolLLM is a framework that enhances open-source LLMs with tool-use capabilities through a comprehensive dataset, efficient decision tree, automatic evaluation, and neural API retrieval.
JiYuan Wang, Chunyu Lin, Lei Sun +6 authors
FE2E, a framework using a Diffusion Transformer for dense geometry prediction, outperforms generative models in zero-shot monocular depth and normal estimation with improved performance and efficiency.
Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez +5 authors
Sapiens, a family of vision models for human-centric tasks, achieves superior performance with self-supervised pretraining and can be easily fine-tuned for 2D pose estimation, body-part segmentation, depth estimation, and surface normal prediction.
Sergey Pletenev, Maria Marina, Daniil Moskovskiy +4 authors
Low-rank adaptation (LoRA) effectively updates LLMs with new knowledge but risks degrading performance on external benchmarks due to data bias and overconfidence.
Chenkai Pan, Xinglong Xu, Yuhang Xu +6 authors
Training data can be structured as source code and evaluated through unit testing, enabling systematic debugging and improvement of language models' domain-specific capabilities.
Hasan Abed Al Kader Hammoud, Mohammad Zbeeb, Bernard Ghanem
Hala, a family of Arabic-centric instruction and translation models, achieves state-of-the-art results using a translate-and-tune pipeline, slerp merging, and fine-tuning on high-quality bilingual supervision.
Bowen Peng, Jeffrey Quesnelle, Honglu Fan +1 authors
YaRN extends the context window of transformer-based language models like LLaMA with improved efficiency and performance.
Valerii Startsev, Alexander Ustyuzhanin, Alexey Kirillov +2 authors
A new method using a pre-trained generative model helps construct a high-impact SFT dataset, Alchemist, which improves the generative quality of text-to-image models while maintaining diversity.
Jintao Zhang, Jia Wei, Pengle Zhang +6 authors
Efficiency enhancements for attention mechanisms, including leveraging FP4 Tensor Cores and developing an 8-bit attention method, improve inference and training performance.
Itay Nakash, Nitay Calderon, Eyal Ben David +2 authors
AdaptiVocab, a novel vocabulary adaptation method, enhances the efficiency of Large Language Models in domain-specific applications without sacrificing performance by reducing token usage.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号