Trends · 研究趋势
数据来自 Hugging Face 论文的 AI 提取关键词,按月统计研究方向的增长与热度。
Zhangchen Xu, Fengqing Jiang, Luyao Niu +4 authors
Magpie, a self-synthesis method, generates high-quality instruction data from aligned LLMs, enabling competitive performance in alignment benchmarks compared to models fine-tuned with larger, supervised datasets.
Xindi Wu, Despoina Paschalidou, Jun Gao +5 authors
Motive is a gradient-based data attribution framework that identifies influential video clips for motion improvement in text-to-video models through motion-weighted loss masking.
Sambal Shikhar, Mohammed Irfan Kurpath, Sahal Shaji Mullappilly +5 authors
LLMVoX is a lightweight, LLM-agnostic TTS system that decouples speech synthesis from model processing, ensuring high-quality speech with low latency and supporting seamless multimodal dialogue.
Renjie Pi, Jianshu Zhang, Tianyang Han +3 authors
A new framework called Personalized Visual Instruction Tuning (PVIT) enhances multimodal large language models to recognize and engage with specific individuals in images, utilizing a curated dataset and benchmarks for evaluation.
Siheng Li, Cheng Yang, Zesen Cheng +4 authors
A novel method enables LLMs to self-improve in long-context reasoning through sampling, scoring with Minimum Bayes Risk, and supervised fine-tuning, outperforming expert-annotated data approaches.
Xun Liang, Hanyu Wang, Yezhaohui Wang +8 authors
Controllable Text Generation techniques for Large Language Models ensure predefined control conditions and high-quality text output, covering content and attribute control through various methods like retraining, fine-tuning, and latent manipulation.
Yiran Zhao, Chaoqun Liu, Yue Deng +8 authors
Babel is an open multilingual LLM that expands its parameter count through layer extension, covering numerous languages and achieving superior performance in multilingual tasks compared to other open LLMs.
Jiazhan Feng, Shijue Huang, Xingwei Qu +6 authors
ReTool, a tool-integrated learning framework, enhances reasoning models with real-time code execution and reinforcement learning, significantly improving performance in structured problem-solving tasks like mathematical reasoning.
Ethem Yağız Çalık, Talha Rüzgar Akkuş
Advancements in enhancing natural language understanding, conversational coherence, and emotional intelligence in large language models improve user interactions and expand AI applications, while future research will address ethical implications and biases.
Zhijian Liu, Ligeng Zhu, Baifeng Shi +24 authors
NVILA, a family of VLMs, optimizes efficiency and accuracy through a scale-then-compress approach, enhancing performance across various benchmarks while reducing computational costs.
Tianle Cai, Yuhong Li, Zhengyang Geng +4 authors
Medusa enhances Large Language Model inference by adding parallel decoding heads and using tree-based attention to predict multiple tokens simultaneously, achieving significant speedup with minimal latency.
Changyue Liao, Mo Sun, Zihan Yang +4 authors
Fuyou enables efficient fine-tuning of large models on low-end GPUs by optimizing SSD-CPU communication and computation, achieving higher GPU utilization compared to ZeRO-Infinity.
Qi Sun, Edoardo Cetin, Yujin Tang
A self-adaptive framework for large language models uses reinforcement learning to dynamically adjust task-specific components during inference, enhancing adaptability and performance with efficiency.
Shouyuan Chen, Sherman Wong, Liangjian Chen +1 authors
Position Interpolation extends the context window of RoPE-based LLMs up to 32768 tokens with minimal fine-tuning, maintaining task performance and stability compared to extrapolation methods.
Haoyu Lu, Wen Liu, Bo Zhang +11 authors
DeepSeek-VL is an open-source vision-language model that achieves state-of-the-art performance in real-world applications by combining a hybrid vision encoder with effective pretraining strategies to preserve language model capabilities.
Wenqi Zhang, Zhenglin Cheng, Yuanyu He +8 authors
A multi-modal self-instruct benchmark using large language models and code capabilities enhances understanding and reasoning for abstract images and visual tasks, improving performance metrics like chart understanding and map navigation.
Yuhui Xu, Lingxi Xie, Xiaotao Gu +6 authors
QA-LoRA algorithm reduces computational requirements for large language models by quantizing weights during fine-tuning and integrating auxiliary weights post-training.
Zhen Huang, Haoyang Zou, Xuefeng Li +7 authors
Knowledge distillation from O1 model combined with fine-tuning achieves superior performance on complex mathematical reasoning and generalizes to open-ended QA tasks, promoting transparency in AI research.
Lifan Yuan, Ganqu Cui, Hanbin Wang +12 authors
Eurus, a suite of reasoning-optimized large language models, achieves state-of-the-art performance on various benchmarks through UltraInteract, a large-scale, high-quality alignment dataset, and a novel reward modeling objective.
Tiannan Wang, Jiamin Chen, Qingrui Jia +43 authors
Weaver, a family of specialized large language models, achieves superior writing capabilities through pre-training and fine-tuning methods, surpasses GPT-4 in various writing tasks, and supports retrieval-augmented generation and tool usage.
北京市昌平区探索星信息技术及软件开发工作室
京ICP备2026059466号