Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
mistralai 's Collections
Devstral 2
Mistral Large 3
Ministral 3
Ministral 3 - Additional Checkpoints
Speech Evals

Speech Evals

updated Nov 28

Synthesized speech evals generated by MistralAI from popular text evaluation datasets to evaluate spoken-language reasoning capabilities of Audio LLMs

Upvote
12

  • mistralai/mmlu_speech

    Viewer • Updated Jul 15 • 14.3k • 532 • 14

  • mistralai/triviaqa_speech

    Viewer • Updated Jul 15 • 17.9k • 146 • 6

  • mistralai/gsm8k_speech

    Viewer • Updated Jul 15 • 1.32k • 109 • 6
Upvote
12
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs