OLMoTrace: Tracing Language Model Outputs Back to Trillions of Training Tokens
Jiacheng Liu, Taylor Blanton, Yanai Elazar +28 authors
OLMoTrace traces language model outputs to their training data in real-time, providing insights into fact checking, hallucination, and creativity through verbatim matches and infini-gram technology.