DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase +16 authors
DeepSpeed-Chat introduces an efficient and accessible RLHF training pipeline for large-scale ChatGPT-like models, enabling rapid and cost-effective training.