TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Feb 10 – Feb 16, 2025

50 篇论文 · 按点赞排序

34

Matryoshka Quantization

Pranav Nair, Puranjay Datta, Jeff Dean +2 authors

Matryoshka Quantization enables a single model to be served at multiple precision levels, improving accuracy of int2 quantization and efficiency.

32quantizing model weightscommunication costsHF ↗arXiv ↗
35

LM2: Large Memory Models

Jikun Kang, Wenqi Wu, Filippos Christianos +5 authors

The Large Memory Model (LM2), a decoder-only Transformer with an auxiliary memory module, improves multi-step reasoning, relational argumentation, and large-context processing while preserving Transformer capabilities.

32Transformer architecturememory moduleHF ↗arXiv ↗
36

LLM Pretraining with Continuous Concepts

Jihoon Tack, Jack Lanchantin, Jane Yu +7 authors

A novel pretraining framework, Continuous Concept Mixing (CoCoMix), integrates continuous concepts from a sparse autoencoder into language models, improving sample efficiency and interpretability.

30Continuous Concept MixingCoCoMixHF ↗arXiv ↗
41

Gemstones: A Model Suite for Multi-Faceted Scaling Laws

Sean McLeish, John Kirchenbauer, David Yu Miller +5 authors

The study analyzes scaling laws with diverse hyperparameters and architectures, releasing an extensive dataset named Gemstones to facilitate complex scaling law predictions in transformer models.

25scaling lawshyper-parameter choicesHF ↗arXiv ↗
47

Agency Is Frame-Dependent

David Abel, André Barreto, Michael Bowling +13 authors

The puzzle of determining agency in systems is explored through the lens of reinforcement learning, establishing that agency is inherently frame-dependent.

23reinforcement learningagencyHF ↗arXiv ↗
2 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号