Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective Decoding
StepFun, Bin Wang, Bojun Wang +196 authors
Step-3, a 321B-parameter VLM, optimizes decoding costs through Multi-Matrix Factorization Attention and Attention-FFN Disaggregation, achieving high efficiency and throughput compared to other models.