TensorX

Explore · 每周精选

发现最受关注的研究论文,追踪研究趋势,订阅感兴趣的期刊与关键词。

Oct 21 – Oct 27, 2024
本周最热93

Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss

Zesen Cheng, Hang Zhang, Kehan Li +6 authors

A tile-based computation strategy optimizes contrastive loss by partitioning calculations, enabling large batch sizes without significant memory or speed sacrifices.

contrastive lossrepresentation learningsimilarity matrixtile-based computationHF ↗arXiv ↗

50 篇论文 · 按点赞排序

09

Baichuan Alignment Technical Report

Mingan Lin, Fan Yang, Yanjun Shen +22 authors

Baichuan Alignment provides comprehensive insights into alignment methodologies used in Baichuan models, detailing improvements through Prompt Augmentation System, Supervised Fine-Tuning, and Preference Alignment across various benchmarks.

51Prompt Augmentation SystemSupervised Fine-TuningHF ↗arXiv ↗
10

SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation

Junyu Luo, Xiao Luo, Xiusi Chen +3 authors

A semi-supervised fine-tuning framework named SemiEvol enhances LLM adaptation using both labeled and unlabeled data, showing improved performance through bi-level knowledge propagation and collaborative learning.

47supervised fine-tuninglarge language modelsHF ↗arXiv ↗
12

Pangea: A Fully Open Multilingual Multimodal LLM for 39 Languages

Xiang Yue, Yueqi Song, Akari Asai +7 authors

Pangea, a multilingual multimodal LLM, is trained on a diverse 6M instruction dataset across 39 languages and evaluated using PangeaBench, demonstrating superior performance in multilingual and cross-cultural settings.

44multimodal large language models (MLLMs)PangeaHF ↗arXiv ↗
13

SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes

Cheng-De Fan, Chen-Wei Chang, Yi-Ruei Liu +4 authors

SpectroMotion improves upon 3D Gaussian Splatting by integrating physical-based rendering and deformation fields, incorporating a residual correction technique and deformable environment map to accurately reconstruct and synthesize dynamic specular scenes.

433D Gaussian Splatting (3DGS)physically-based rendering (PBR)HF ↗arXiv ↗
17

Framer: Interactive Frame Interpolation

Wen Wang, Qiuyu Wang, Kecheng Zheng +6 authors

Framer is an interactive frame interpolation system that allows users to customize transitions between images using keypad manipulation and includes an autopilot mode for automatic keypoint estimation.

38frame interpolationkeypointHF ↗arXiv ↗
22

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs

Yizhao Gao, Zhichen Zeng, Dayou Du +5 authors

SeerAttention introduces a learnable attention mechanism that adaptsively selects significant blocks in attention maps, balancing accuracy and speed, and achieves superior performance over static or heuristic-based sparse attention methods.

28attentionLarge Language ModelsHF ↗arXiv ↗
29

DPLM-2: A Multimodal Diffusion Protein Language Model

Xinyou Wang, Zaixiang Zheng, Fei Ye +3 authors

DPLM-2 is a multimodal protein foundation model that simultaneously generates amino acid sequences and their 3D structures using a discrete diffusion approach, improving performance in tasks like folding and scaffold prediction.

21discrete diffusion protein language modelDPLMHF ↗arXiv ↗
1 / 2

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号