Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Benjamin Warner, Antoine Chaffin, Benjamin Clavié +11 authors
ModernBERT, an optimized encoder-only transformer model, demonstrates superior performance and efficiency in diverse classification and retrieval tasks compared to previous models.