Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2504.19874

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

291

Base only

Active filters: 2504.19874

majentik/gemma-4-E2B-TurboQuant-MLX-2bit

Image-Text-to-Text • 0.9B • Updated 29 days ago • 375 • 2

majentik/gemma-4-E4B-RotorQuant-MLX-8bit

Image-Text-to-Text • 3B • Updated 29 days ago • 482 • 1

majentik/gemma-4-E4B-RotorQuant-MLX-4bit

Image-Text-to-Text • 2B • Updated 29 days ago • 295 • 1

majentik/gemma-4-E2B-RotorQuant-GGUF-Q4_K_M

Image-Text-to-Text • 5B • Updated 29 days ago • 465 • 1

majentik/gemma-4-E2B-it-RotorQuant-GGUF-Q5_K_M

Image-Text-to-Text • 5B • Updated 29 days ago • 355 • 2

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-2bit

Image-Text-to-Text • 35B • Updated 29 days ago • 3.04k • 6

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-2bit

Image-Text-to-Text • 35B • Updated 29 days ago • 1.31k • 3

majentik/Qwen3.6-35B-A3B-TurboQuant-MLX-8bit

Image-Text-to-Text • 35B • Updated 29 days ago • 2.31k • 7

cudabenchmarktest/personaplex-7b-turbo2bit

Updated Mar 29 • 25 • 4

vivekvar/turboquant

Updated Mar 29 • 13

infohound/cogito-14b-voice-GGUF

Text Generation • 15B • Updated Mar 30 • 250 • 2

viberobin/Wan2.2-TI2V-5B-VedioQuant

Text-to-Video • Updated Mar 31

osmapi/sarvam-30b-TQ3_1S-GGUF

Text Generation • Updated Apr 2 • 5 • 2

lew96123/qwen3.5-0.8b-custom-packed-8bit

Image-Text-to-Text • Updated Apr 6 • 2

lew96123/qwen3.5-0.8b-custom-packed-4bit

Image-Text-to-Text • Updated Apr 6 • 2

lew96123/qwen3.5-0.8b-custom-packed-2bit

Image-Text-to-Text • Updated Apr 6 • 7

lew96123/qwen3.5-0.8b-custom-packed-1bit

Image-Text-to-Text • Updated Apr 6 • 5

majentik/gemma-4-E4B-turboquant

Image-Text-to-Text • 8B • Updated 29 days ago • 464 • 7

majentik/MERaLiON-3-10B-TurboQuant

Automatic Speech Recognition • Updated 29 days ago

majentik/MERaLiON-2-3B-TurboQuant

Automatic Speech Recognition • Updated 29 days ago

majentik/MERaLiON-2-10B-TurboQuant

Automatic Speech Recognition • Updated 29 days ago

lew96123/qwen3.5-0.8b-custom-packed-turboquant_mse-true-uniform-4bit

Image-Text-to-Text • Updated Apr 7 • 3 • 1

lew96123/qwen3.5-0.8b-custom-packed-turboquant_mse-true-uniform-2bit

Image-Text-to-Text • Updated Apr 7 • 3

varjosoft/gemma-4-26B-A4B-it-TQ3

Text Generation • 26B • Updated Apr 7 • 154 • 3

varjosoft/gemma-4-26B-A4B-it-TQ3-native

Text Generation • 11B • Updated Apr 7 • 2.04k • 1

lew96123/qwen3.5-0.8b-custom-packed-turboquant_mse-true-uniform-1bit

Image-Text-to-Text • Updated Apr 7 • 1

manjunathshiva/gpt-oss-20b-tq3

Text Generation • 22B • Updated 6 days ago • 4.7k • 46

varjosoft/GLM-5.1-Open-TQ3

Text Generation • 289B • Updated Apr 9 • 565 • 2

nwzjk/GLM-5.1-Open-TQ3

Text Generation • 289B • Updated Apr 9 • 6 • 2

majentik/gemma-4-E4B-rotorquant

Image-Text-to-Text • Updated 29 days ago • 1