TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Nov 4 – Nov 10, 2024

50 篇论文 · 按点赞排序

31

Self-Consistency Preference Optimization

Archiki Prasad, Weizhe Yuan, Richard Yuanzhe Pang +6 authors

Self-consistency preference optimization (ScPO) enhances model training by iteratively preferring consistent answers, improving performance on reasoning tasks and outperforming larger models on specific benchmarks.

20self-alignmentself-consistencyHF ↗arXiv ↗
32

GenXD: Generating Any 3D and 4D Scenes

Yuyang Zhao, Chung-Ching Lin, Kevin Lin +6 authors

A framework called GenXD generates 3D and 4D scenes from multiview-temporal data, leveraging camera and object movements, and demonstrates superior performance compared to existing methods.

20multiview-temporal modulesmasked latent conditionsHF ↗arXiv ↗
33

Randomized Autoregressive Visual Generation

Qihang Yu, Ju He, Xueqing Deng +2 authors

Randomized AutoRegressive modeling (RAR) improves autoregressive image generation by randomly permuting input sequences during training, outperforming existing methods on the ImageNet-256 benchmark.

19Randomized AutoRegressive modelingRARHF ↗arXiv ↗
43

Physics in Next-token Prediction

Hongjun An, Yiliang Song, Xuelong Li

The study identifies laws of information capacity in Next-token Prediction and applies Landauer's Principle to relate auto-regressive model training to energy consumption.

14Next-token PredictionFirst Law of Information CapacityHF ↗arXiv ↗
46

GPT or BERT: why not both?

Lucas Georges Gabriel Charpentier, David Samuel

A hybrid model combining masked and causal language modeling within a transformer stack outperforms models using either paradigm alone.

13masked language modelingcausal language modelingHF ↗arXiv ↗
47

Adaptive Length Image Tokenization via Recurrent Allocation

Shivam Duggal, Phillip Isola, Antonio Torralba +1 authors

A new method for learning variable-length token representations for 2D images through recursive processing and token specialization is proposed, validated by reconstruction loss and FID metrics.

12variable-length token representationsencoder-decoder architectureHF ↗arXiv ↗
49

Sample-Efficient Alignment for LLMs

Zichen Liu, Changyu Chen, Chao Du +2 authors

A sample-efficient algorithm called SEA is introduced for aligning large language models with human preferences using contextual dueling bandits and Thompson sampling.

11contextual dueling banditsonline RLHFHF ↗arXiv ↗
2 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号