On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
Mind Lab, Song Cao, Vic Cao +51 authors
Parameter-efficient fine-tuning can function as a compact substrate for persistent personal models by enabling small trainable adapters to store instance-specific behaviors on top of strong foundation models.