DistilBERT release Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints. distilbert/distilbert-base-cased Fill-Mask β’ 65.8M β’ Updated May 6, 2024 β’ 168k β’ β’ 54 distilbert/distilbert-base-uncased Fill-Mask β’ 67M β’ Updated May 6, 2024 β’ 10.8M β’ β’ 803 distilbert/distilbert-base-multilingual-cased Fill-Mask β’ 0.1B β’ Updated May 6, 2024 β’ 767k β’ β’ 225 distilbert/distilbert-base-uncased-finetuned-sst-2-english Text Classification β’ 67M β’ Updated Dec 19, 2023 β’ 4.55M β’ β’ 858
distilbert/distilbert-base-multilingual-cased Fill-Mask β’ 0.1B β’ Updated May 6, 2024 β’ 767k β’ β’ 225
distilbert/distilbert-base-uncased-finetuned-sst-2-english Text Classification β’ 67M β’ Updated Dec 19, 2023 β’ 4.55M β’ β’ 858
DistilBERT release Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints. distilbert/distilbert-base-cased Fill-Mask β’ 65.8M β’ Updated May 6, 2024 β’ 168k β’ β’ 54 distilbert/distilbert-base-uncased Fill-Mask β’ 67M β’ Updated May 6, 2024 β’ 10.8M β’ β’ 803 distilbert/distilbert-base-multilingual-cased Fill-Mask β’ 0.1B β’ Updated May 6, 2024 β’ 767k β’ β’ 225 distilbert/distilbert-base-uncased-finetuned-sst-2-english Text Classification β’ 67M β’ Updated Dec 19, 2023 β’ 4.55M β’ β’ 858
distilbert/distilbert-base-multilingual-cased Fill-Mask β’ 0.1B β’ Updated May 6, 2024 β’ 767k β’ β’ 225
distilbert/distilbert-base-uncased-finetuned-sst-2-english Text Classification β’ 67M β’ Updated Dec 19, 2023 β’ 4.55M β’ β’ 858