The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning
Bill Yuchen Lin, Abhilasha Ravichander, Ximing Lu +5 authors
A study explores the effectiveness of alignment tuning in large language models, suggesting that superficial methods like in-context learning can achieve strong performance without traditional supervised fine-tuning or reinforcement learning.