TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Oct 16 – Oct 22, 2023

42 篇论文 · 按点赞排序

31

Video Language Planning

Yilun Du, Mengjiao Yang, Pete Florence +10 authors

Video language planning leverages vision-language and text-to-video models to generate detailed long-horizon video plans, improving task success rates across multiple robotics domains.

11video language planningtree search procedureHF ↗arXiv ↗
35

Farzi Data: Autoregressive Data Distillation

Noveen Sachdeva, Zexue He, Wang-Cheng Kang +3 authors

Farzi distills large event sequence datasets into smaller synthetic datasets, significantly reducing data size while maintaining high model performance for auto-regressive tasks.

9Farzidata distillationHF ↗arXiv ↗
37

Microscaling Data Formats for Deep Learning

Bita Darvish Rouhani, Ritchie Zhao, Ankit More +29 authors

Microscaling data formats reduce computational and storage costs while maintaining model accuracy and enabling sub-8-bit training for generative language models.

7narrow bit-width data formatsMicroscaling (MX) data formatsHF ↗arXiv ↗
41

When can transformers reason with abstract symbols?

Enric Boix-Adsera, Omid Saremi, Emmanuel Abbe +3 authors

Transformers require vast amounts of data for regression tasks and exhibit decreased generalization with higher embedding dimensions in symbolic next-token-prediction tasks, but simple parameter modifications can improve their performance.

3transformer large language modelsrelational reasoningHF ↗arXiv ↗
2 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号