TensorX
返回文献探索

Paper · arXiv 2409.03753

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Yuntian Deng, Wenting Zhao, Jack Hessel, Xiang Ren, Claire Cardie, Yejin Choi

19 upvotesSeptember 5, 2024arXiv 预印本
AI 摘要

WildVis is an interactive tool for large-scale conversation analysis, providing search and visualization capabilities in text and embedding spaces with optimizations for handling million-scale datasets.

embedding spacessearch index constructionembedding precomputationcompressioncachinguser interactionschatbot misusetopic distributionsuser-specific conversation patterns

Abstract

The increasing availability of real-world conversation data offers exciting opportunities for researchers to study user-chatbot interactions. However, the sheer volume of this data makes manually examining individual conversations impractical. To overcome this challenge, we introduce WildVis, an interactive tool that enables fast, versatile, and large-scale conversation analysis. WildVis provides search and visualization capabilities in the text and embedding spaces based on a list of criteria. To manage million-scale datasets, we implemented optimizations including search index construction, embedding precomputation and compression, and caching to ensure responsive user interactions within seconds. We demonstrate WildVis's utility through three case studies: facilitating chatbot misuse research, visualizing and comparing topic distributions across datasets, and characterizing user-specific conversation patterns. WildVis is open-source and designed to be extendable, supporting additional datasets and customized search and visualization functionalities.

北京市昌平区探索星信息技术及软件开发工作室

京ICP备2026059466号
WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild | TensorX