TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Jul 10 – Jul 16, 2023

50 篇论文 · 按点赞排序

35

Test-Time Training on Video Streams

Renhao Wang, Yu Sun, Yossi Gandelsman +3 authors

Online test-time training (TTT) framework for video frames improves performance by using a small temporal window compared to fixed-model or offline TTT methods.

7test-time trainingTTTHF ↗arXiv ↗
38

SVIT: Scaling up Visual Instruction Tuning

Bo Zhao, Boya Wu, Tiejun Huang

A new dataset of 3.2 million visual instruction tuning pairs improves multimodal performance in visual perception, reasoning, and planning by training on high-quality, diverse manual annotations.

7foundation modelslarge language modelsHF ↗arXiv ↗
41

SITTA: A Semantic Image-Text Alignment for Image Captioning

Fabian Paischer, Thomas Adler, Markus Hofmarcher +1 authors

The paper presents novel methods for constructing semantic mappings between image and language embedding spaces, enabling effective image captioning without extensive gradient information.

6pretrained language modelsmulti-modal modelsHF ↗arXiv ↗
43

International Institutions for Advanced AI

Lewis Ho, Joslyn Barnhart, Robert Trager +8 authors

International institutions may have an important role to play in ensuring advanced AI systems benefit humanity. International collaborations can unlock AI's ability to further sustainable development, and coordination of regulatory efforts can reduce obstacles to innovation and the spread of benefits. Conversely, the potential dangerous capabilities of powerful and general-purpose AI systems create global externalities in their development and deployment, and international efforts to further responsible AI practices could help manage the risks they pose. This paper identifies a set of governance functions that could be performed at an international level to address these challenges, ranging from supporting access to frontier AI systems to setting international safety standards. It groups these functions into four institutional models that exhibit internal synergies and have precedents in existing organizations: 1) a Commission on Frontier AI that facilitates expert consensus on opportunities and risks from advanced AI, 2) an Advanced AI Governance Organization that sets international standards to manage global threats from advanced models, supports their implementation, and possibly monitors compliance with a future governance regime, 3) a Frontier AI Collaborative that promotes access to cutting-edge AI, and 4) an AI Safety Project that brings together leading researchers and engineers to further AI safety research. We explore the utility of these models and identify open questions about their viability.

5Commission on Frontier AIAdvanced AI Governance OrganizationHF ↗arXiv ↗
44

Solvent: A Framework for Protein Folding

Jaemyung Lee, Jaehoon Kim, Hasun Yu +1 authors

Solvent is a unified protein folding framework that supports various state-of-the-art models, enabling consistent and fair comparisons in the protein structure modeling field.

5protein foldingAlphaFold2HF ↗arXiv ↗
45

RLTF: Reinforcement Learning from Unit Test Feedback

Jiate Liu, Yiqin Zhu, Kaiwen Xiao +4 authors

A new reinforcement learning framework using multi-granularity unit test feedback enhances code generation with large language models, achieving superior performance on benchmarks.

5reinforcement learninglarge language modelsHF ↗arXiv ↗
46

Frontier AI Regulation: Managing Emerging Risks to Public Safety

Markus Anderljung, Joslyn Barnhart, Jade Leung +21 authors

Advanced AI models hold the promise of tremendous benefits for humanity, but society needs to proactively manage the accompanying risks. In this paper, we focus on what we term "frontier AI" models: highly capable foundation models that could possess dangerous capabilities sufficient to pose severe risks to public safety. Frontier AI models pose a distinct regulatory challenge: dangerous capabilities can arise unexpectedly; it is difficult to robustly prevent a deployed model from being misused; and, it is difficult to stop a model's capabilities from proliferating broadly. To address these challenges, at least three building blocks for the regulation of frontier models are needed: (1) standard-setting processes to identify appropriate requirements for frontier AI developers, (2) registration and reporting requirements to provide regulators with visibility into frontier AI development processes, and (3) mechanisms to ensure compliance with safety standards for the development and deployment of frontier AI models. Industry self-regulation is an important first step. However, wider societal discussions and government intervention will be needed to create standards and to ensure compliance with them. We consider several options to this end, including granting enforcement powers to supervisory authorities and licensure regimes for frontier AI models. Finally, we propose an initial set of safety standards. These include conducting pre-deployment risk assessments; external scrutiny of model behavior; using risk assessments to inform deployment decisions; and monitoring and responding to new information about model capabilities and uses post-deployment. We hope this discussion contributes to the broader conversation on how to balance public safety risks and innovation benefits from advances at the frontier of AI development.

5HF ↗arXiv ↗
49

Toward Interactive Dictation

Belinda Z. Li, Jason Eisner, Adam Pauls +1 authors

A study explores real-time spoken interruption for dictation and editing using large pre-trained language models, showing a trade-off between accuracy and latency.

4large pre-trained language modelsend-state accuracyHF ↗arXiv ↗
2 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号