TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Jul 24 – Jul 30, 2023
本周最热45

WavJourney: Compositional Audio Creation with Large Language Models

Xubo Liu, Zhongkai Zhu, Haohe Liu +8 authors

WavJourney leverages Large Language Models to generate structured audio scripts from text, which are then processed by task-specific audio models to create audio content, enabling explainable and human-controlled audio production.

Large Language ModelsWavJourneyaudio storytellingaudio scriptsHF ↗arXiv ↗

40 篇论文 · 按点赞排序

03

3D-LLM: Injecting the 3D World into Large Language Models

Yining Hong, Haoyu Zhen, Peihao Chen +4 authors

A new family of 3D-LLMs is introduced to perform 3D-related tasks by leveraging 3D point clouds and features, outperforming state-of-the-art baselines in tasks such as 3D question answering and captioning.

40LLMsVision-Language ModelsHF ↗arXiv ↗
08

Scaling TransNormer to 175 Billion Parameters

Zhen Qin, Dong Li, Weigao Sun +9 authors

TransNormerLLM, a linear attention-based LLM, outperforms softmax attention models through advanced modifications like positional embedding, lightning attention, gating mechanisms, and tensor normalization, achieving better accuracy and efficiency.

23linear attentionsoftmax attentionHF ↗arXiv ↗
09

Interpolating between Images with Diffusion Models

Clinton J. Wang, Polina Golland

Latent diffusion models enable zero-shot image interpolation by denoising in latent space with text embeddings and pose conditions, producing high-quality interpolations across varied subjects, styles, and content.

21latent diffusion modelslatent spaceHF ↗arXiv ↗
11

ARB: Advanced Reasoning Benchmark for Large Language Models

Tomohiro Sawada, Daniel Paleka, Alexander Havrilla +6 authors

ARB is a novel benchmark featuring advanced reasoning problems across multiple domains, demonstrating that current LLMs score poorly on more challenging tasks and introducing a rubric-based evaluation approach.

19Large Language Models (LLMs)ARBHF ↗arXiv ↗
12

Prompting Large Language Models with Speech Recognition Abilities

Yassir Fathullah, Chunyang Wu, Egor Lakomkin +9 authors

Attaching a conformer audio encoder to LLaMA-7B allows it to perform multilingual speech recognition, outperforming monolingual models and maintaining its original text capabilities, even with limited training and longer strides.

18large language modelsspeech recognitionHF ↗arXiv ↗
13

Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning

Jian Ma, Junhao Liang, Chen Chen +1 authors

Subject-Diffusion, a novel open-domain personalized image generation model, uses a unified framework combining text and image semantics, coarse location control, fine-grained reference image control, and attention mechanism to generate accurate and flexible images without the need for fine-tuning or multiple reference images.

17diffusion modelsSubject-DiffusionHF ↗arXiv ↗
15

Scaling Up and Distilling Down: Language-Guided Robot Skill Acquisition

Huy Ha, Pete Florence, Shuran Song

The framework scales up the generation of language-labeled robot data using a large language model and sampling-based planners, then distills it into a multi-task language-conditioned visuo-motor policy, achieving improved success rates on a new multi-task benchmark.

15large language modelsampling-based robot plannersHF ↗arXiv ↗
16

Tracking Anything in High Quality

Jiawen Zhu, Zhenyu Chen, Zeqi Hao +9 authors

HQTrack is a high-quality tracking framework using a video multi-object segmenter and a mask refiner to achieve competitive results in the VOTS2023 challenge.

15video multi-object segmentermask refinerHF ↗arXiv ↗
18

PUMA: Secure Inference of LLaMA-7B in Five Minutes

Ye Dong, Wen-jie Lu, Yancheng Zheng +7 authors

PUMA framework accelerates secure Transformer model inference using high-quality approximations and secure procedures, achieving faster performance and maintaining accuracy compared to existing methods.

15MPCTransformer modelsHF ↗arXiv ↗
19

Towards Generalist Biomedical AI

Tao Tu, Shekoofeh Azizi, Danny Driess +29 authors

A large multimodal generative model demonstrates competitive performance across diverse biomedical tasks, including zero-shot generalization and transfer learning, suggesting potential clinical utility.

14multimodalbiomedical AIHF ↗arXiv ↗
24

How to Scale Your EMA

Dan Busbridge, Jason Ramapuram, Pierre Ablin +4 authors

A scaling rule for optimization with Exponential Moving Average (EMA) improves performance and enables efficient training of pseudo-labeling and SSL methods, including BYOL, at various batch sizes.

9stochastic gradient descentExponential Moving Average (EMA)HF ↗arXiv ↗
29

Predicting Code Coverage without Execution

Michele Tufano, Shubham Chandel, Anisha Agarwal +2 authors

Code coverage is a widely used metric for quantifying the extent to which program elements, such as statements or branches, are executed during testing. Calculating code coverage is resource-intensive, requiring code building and execution with additional overhead for the instrumentation. Furthermore, computing coverage of any snippet of code requires the whole program context. Using Machine Learning to amortize this expensive process could lower the cost of code coverage by requiring only the source code context, and the task of code coverage prediction can be a novel benchmark for judging the ability of models to understand code. We propose a novel benchmark task called Code Coverage Prediction for Large Language Models (LLMs). We formalize this task to evaluate the capability of LLMs in understanding code execution by determining which lines of a method are executed by a given test case and inputs. We curate and release a dataset we call COVERAGEEVAL by executing tests and code from the HumanEval dataset and collecting code coverage information. We report the performance of four state-of-the-art LLMs used for code-related tasks, including OpenAI's GPT-4 and GPT-3.5-Turbo, Google's BARD, and Anthropic's Claude, on the Code Coverage Prediction task. Finally, we argue that code coverage as a metric and pre-training data source are valuable for overall LLM performance on software engineering tasks.

9Large Language Models (LLMs)Code Coverage PredictionHF ↗arXiv ↗
1 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号