Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models
Yao Shu, Wenyang Hu, See-Kiong Ng +2 authors
Ferret is a federated full-parameter tuning method for LLMs that achieves high efficiency, reduced communication overhead, and competitive accuracy using first-order methods and shared randomness.