Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,812

Full-text search

Active filters: 4-bit

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated 7 days ago • 145k • 39

mlx-community/Qwen3.5-9B-MLX-4bit

2B • Updated 8 days ago • 57.9k • 34

Qwen/Qwen3.5-122B-A10B-GPTQ-Int4

Image-Text-to-Text • 125B • Updated 7 days ago • 26.4k • 21

Qwen/Qwen3.5-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 7 days ago • 58.8k • 21

Intel/Qwen3.5-9B-int4-AutoRound

4B • Updated 5 days ago • 9.43k • 16

Qwen/Qwen3.5-397B-A17B-GPTQ-Int4

Image-Text-to-Text • Updated 7 days ago • 4.03k • 14

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-4bit

27B • Updated 4 days ago • 2.94k • 14

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 13 days ago • 29.1k • 29

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 5 days ago • 1.6k • 10

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 13 days ago • 25.2k • 20

Intel/Qwen3.5-35B-A3B-int4-AutoRound

6B • Updated 10 days ago • 7.3k • 20

Kbenkhaled/Qwen3.5-27B-NVFP4

Image-Text-to-Text • 17B • Updated 11 days ago • 10.8k • 12

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated 9 days ago • 27.3k • 15

mlx-community/Qwen3.5-4B-MLX-4bit

1.0B • Updated 8 days ago • 11.3k • 9

z-lab/Qwen3.5-4B-PARO

Image-Text-to-Text • 1B • Updated 2 days ago • 289 • 6

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 8 days ago • 138k • 13

mlx-community/Qwen3.5-9B-4bit

Image-Text-to-Text • 2B • Updated 7 days ago • 13.2k • 7

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated 6 days ago • 1.03k • 5

z-lab/Qwen3.5-9B-PARO

Image-Text-to-Text • 3B • Updated 2 days ago • 124 • 5

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated 13 days ago • 8.43k • 7

kaitchup/Qwen3.5-27B-autoround-W4A16

7B • Updated 11 days ago • 1.55k • 8

RepublicOfKorokke/Qwen3.5-9B-mlx-vlm-mxfp4

Text Generation • 2B • Updated 8 days ago • 590 • 4

TheCluster/Qwen3.5-9B-Heretic-MLX-mxfp4

Image-Text-to-Text • 2B • Updated 7 days ago • 1.26k • 4

neuralnets/sarvam-30b-4bit

32B • Updated 2 days ago • 43 • 4

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated 28 days ago • 10.2k • 15

Kbenkhaled/Qwen3.5-35B-A3B-NVFP4

Image-Text-to-Text • Updated 11 days ago • 6.3k • 7

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 12 days ago • 24.4k • 13

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-4bit

Image-Text-to-Text • 35B • Updated 7 days ago • 1.4k • 3

mlx-community/Qwen3.5-4B-4bit

1.0B • Updated 8 days ago • 55k • 4

QuantTrio/Qwen3.5-9B-AWQ

Image-Text-to-Text • 10B • Updated 6 days ago • 9.61k • 3