TensorX
返回文献探索

Paper · arXiv 2506.12571

DoTA-RAG: Dynamic of Thought Aggregation RAG

Saksorn Ruangtanusak, Natthapath Rungseesiripak, Peerawat Rojratchadakorn, Monthol Charattrakool, Natapong Nitarach

51 upvotesJune 14, 2025arXiv 预印本
AI 摘要

DoTA-RAG improves retrieval and generation accuracy over massive web datasets using a dynamic routing pipeline and optimized embedding models, achieving high correctness scores while maintaining low latency.

RAGDoTA-RAGquery rewritingdynamic routingspecialized sub-indexesmulti-stage retrievalrankingembedding modelsre-embeddingFineWeb-10BTQ&A datasetDataMorganaLiveRAGLive Challenge Day

Abstract

In this paper, we introduce DoTA-RAG (Dynamic-of-Thought Aggregation RAG), a retrieval-augmented generation system optimized for high-throughput, large-scale web knowledge indexes. Traditional RAG pipelines often suffer from high latency and limited accuracy over massive, diverse datasets. DoTA-RAG addresses these challenges with a three-stage pipeline: query rewriting, dynamic routing to specialized sub-indexes, and multi-stage retrieval and ranking. We further enhance retrieval by evaluating and selecting a superior embedding model, re-embedding the large FineWeb-10BT corpus. Moreover, we create a diverse Q&A dataset of 500 questions generated via the DataMorgana setup across a broad range of WebOrganizer topics and formats. DoTA-RAG improves the answer correctness score from 0.752 (baseline, using LiveRAG pre-built vector store) to 1.478 while maintaining low latency, and it achieves a 0.929 correctness score on the Live Challenge Day. These results highlight DoTA-RAG's potential for practical deployment in domains requiring fast, reliable access to large and evolving knowledge sources.

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号
DoTA-RAG: Dynamic of Thought Aggregation RAG | TensorX