LightThinker: Thinking Step-by-Step Compression
Jintian Zhang, Yuqi Zhu, Mengshu Sun +6 authors
LightThinker improves efficiency in LLMs by dynamically compressing intermediate thoughts, reducing memory usage and inference time while maintaining performance.