Exponentially Faster Language Modelling
Peter Belcak, Roger Wattenhofer
FastBERT achieves significant inference speedup over BERT by selectively engaging a small fraction of neurons using fast feedforward networks.
Explore · 每周精选
发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。
本月最热253 赞
GAIA: a benchmark for General AI Assistants
Grégoire Mialon, Clémentine Fourrier, Craig Swift +3 authors
GAIA benchmarks general AI assistants using real-world questions that challenge both reasoning and multi-modality handling, showcasing a significant gap between human and AI performance.
50 篇论文 · 按点赞排序
Florence-2: Advancing a Unified Representation for a Variety of Vision Tasks
Bin Xiao, Haiping Wu, Weijian Xu +6 authors
A new prompt-based vision foundation model, Florence-2, is introduced for diverse vision and vision-language tasks, achieving strong zero-shot and fine-tuning capabilities with comprehensive annotations.
LCM-LoRA: A Universal Stable-Diffusion Acceleration Module
Simian Luo, Yiqin Tan, Suraj Patil +6 authors
LCMs enhance text-to-image generation by distilling from LDMs using LoRA for reduced memory and superior quality, and introduce LCM-LoRA as a plug-in accelerator for various tasks.
Orca 2: Teaching Small Language Models How to Reason
Arindam Mitra, Luciano Del Corro, Shweti Mahajan +12 authors
Orca 2 enhances smaller language models' reasoning abilities by teaching them diverse solution strategies, outperforming larger models on complex reasoning tasks.
Make Pixels Dance: High-Dynamic Video Generation
Yan Zeng, Guoqiang Wei, Jiani Zheng +4 authors
PixelDance, a diffusion model-based approach, generates high-dynamic videos by incorporating image instructions for first and last frames alongside text instructions, surpassing current text-to-video methods in complexity and motion.
FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipeline
Vladimir Arkhipkin, Zein Shaheen, Viacheslav Vasilev +3 authors
A new two-stage latent diffusion model generates videos from text, achieving high quality and efficiency in keyframe synthesis and interpolation.
The Chosen One: Consistent Characters in Text-to-Image Diffusion Models
Omri Avrahami, Amir Hertz, Yael Vinker +5 authors
A new automated method generates consistent characters from text prompts by iteratively refining a set of similar images.
Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling
Sanchit Gandhi, Patrick von Platen, Alexander M. Rush
Distil-Whisper, a smaller and faster variant of the Whisper model, achieves nearly the same performance with fewer resources and is optimized for low-latency environments.
LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
Jaeyoung Chung, Suyoung Lee, Hyeongjin Nam +2 authors
LucidDreamer generates domain-free 3D scenes using diffusion-based generative models and Gaussian splats, producing highly detailed results.
LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents
Shilong Liu, Hao Cheng, Haotian Liu +10 authors
LLaVA-Plus, a general-purpose multimodal assistant, enhances large multimodal models by integrating pre-trained vision and vision-language models, performing tool-assisted tasks and improving interaction through direct image grounding.
LRM: Large Reconstruction Model for Single Image to 3D
Yicong Hong, Kai Zhang, Jiuxiang Gu +7 authors
A Large Reconstruction Model using a transformer-based architecture predicts 3D neural radiance fields from single images using massive multi-view training data.
Diffusion Model Alignment Using Direct Preference Optimization
Bram Wallace, Meihua Dang, Rafael Rafailov +7 authors
A method called Diffusion-DPO aligns text-to-image diffusion models to human preferences using direct optimization on comparison data, improving visual appeal and prompt alignment.
ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs
Viraj Shah, Nataniel Ruiz, Forrester Cole +4 authors
ZipLoRA effectively combines independently trained style and subject LoRAs to enhance both subject and style fidelity in generative models.
UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs
Yanwu Xu, Yang Zhao, Zhisheng Xiao +1 authors
UFOGen, a hybrid diffusion-GAN model, achieves efficient one-step text-to-image synthesis at high quality.
Drivable 3D Gaussian Avatars
Wojciech Zielonka, Timur Bagautdinov, Shunsuke Saito +3 authors
A new 3D controllable avatar model uses Gaussian splats for photorealistic rendering in real-time, employing cage deformations driven by joint angles and keypoints, outperforming existing methods.
Instant3D: Instant Text-to-3D Generation
Ming Li, Pan Zhou, Jia-Wei Liu +4 authors
A framework named Instant3D generates 3D objects from text prompts in under one second using a novel network and adaptive algorithms to enhance efficiency and quality.
Music ControlNet: Multiple Time-varying Controls for Music Generation
Shih-Lun Wu, Chris Donahue, Shinji Watanabe +1 authors
Music ControlNet, a diffusion-based model, introduces precise, time-varying control over audio generation, offering enhanced realism and efficiency compared to existing models.
System 2 Attention (is something you might need too)
Jason Weston, Sainbayar Sukhbaatar
System 2 Attention in Transformer-based Large Language Models improves factual accuracy and reduces bias by refining input context.
LLaVA-Interactive: An All-in-One Demo for Image Chat, Segmentation, Generation and Editing
Wei-Ge Chen, Irina Spiridonova, Jianwei Yang +2 authors
LLaVA-Interactive is a cost-efficient multimodal dialogue system that integrates visual chat, image segmentation, and generation capabilities to enhance human-AI interaction.
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
Minghua Liu, Ruoxi Shi, Linghao Chen +7 authors
One-2-3-45++ generates detailed 3D meshes from a single image using fine-tuned 2D diffusion models and multi-view conditioned 3D diffusion models, balancing speed and quality.
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
David Rein, Betty Li Hou, Asa Cooper Stickland +5 authors
A dataset of extremely difficult multiple-choice questions challenges both experts and AI systems, facilitating the development of scalable oversight methods for AI-generated knowledge.
FlashDecoding++: Faster Large Language Model Inference on GPUs
Ke Hong, Guohao Dai, Jiaming Xu +6 authors
FlashDecoding++ addresses challenges in LLM inference through asynchronized softmax, flat GEMM optimization, and heuristic dataflow adaptation, achieving significant speedups.
MultiLoRA: Democratizing LoRA for Better Multi-Task Learning
Yiming Wang, Yu Lin, Xiaodong Zeng +1 authors
MultiLoRA improves multi-task adaptation for large language models by reducing the dominance of top singular vectors in LoRA parameter updates through horizontal scaling and modified initialization.
JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models
Zihao Wang, Shaofei Cai, Anji Liu +9 authors
JARVIS-1, an open-world agent in Minecraft, uses multimodal perception and a memory system to perform complex tasks and improve over time.
GLaMM: Pixel Grounding Large Multimodal Model
Hanoona Rasheed, Muhammad Maaz, Sahal Shaji +7 authors
GLaMM is a multimodal model that generates visually grounded language responses with object segmentation masks from both text and optional visual prompts.
Levels of AGI for Operationalizing Progress on the Path to AGI
Meredith Ringel Morris, Jascha Sohl-dickstein, Noah Fiedel +5 authors
The framework proposes a classification system for AGI capabilities and behavior using levels of performance and generality, with principles to assess risks and measure progress.
Contrastive Chain-of-Thought Prompting
Yew Ken Chia, Guizhen Chen, Luu Anh Tuan +2 authors
Contrastive chain of thought, utilizing both valid and invalid reasoning examples, improves language model reasoning and generalization compared to conventional methods.
ChatAnything: Facetime Chat with LLM-Enhanced Personas
Yilin Zhao, Xinbin Yuan, Shanghua Gao +4 authors
A framework for generating anthropomorphized personas with diverse voices and appearances from text descriptions using LLMs and generative models, with improved face landmark detection for automatic animation.
OtterHD: A High-Resolution Multi-modality Model
Bo Li, Peiyuan Zhang, Jingkang Yang +3 authors
OtterHD-8B, an advanced multimodal model from Fuyu-8B, excels in processing high-resolution inputs and discerning detailed spatial relationships through MagnifierBench, an evaluation framework highlighting the importance of vision encoder flexibility.