Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,534

Base only

Active filters: quantization

w-ahmad/Qwen3.5-9B-GGUF-MoQ

Text Generation • 9B • Updated 2 days ago • 53.8k • 13

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 912k • 108

k0valik/Darwin-28B-Coder-IQ4_XS12.9GiB-GGUF

Text Generation • 27B • Updated 10 days ago • 715 • 5

tsolful/Z-Image-L2P-INT8

Text-to-Image • Updated 5 days ago • 13

YTan2000/Qwopus3.6-27B-v2-TQ3_4S

Image-Text-to-Text • 27B • Updated 8 days ago • 964 • 13

Reza2kn/LocateAnything-3B-ONNX-WebGPU-INT4

Object Detection • Updated 2 days ago • 106 • 4

JANGQ-AI/MiniMax-M2.7-JANGTQ_K

Text Generation • 20B • Updated 23 days ago • 1.79k • 11

tonera/waiNSFWIllustrious_v150

Text-to-Image • Updated Jan 23 • 47 • 2

embedl/sam3

Updated 6 days ago • 40 • 4

tonera/FLUX.2-klein-9B-Nunchaku

Image-to-Image • Updated 17 days ago • 2k • 14

lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound

Image-Text-to-Text • 3B • Updated Apr 28 • 3.31k • 6

YTan2000/Qwen3.6-35B-A3B-MTP-TQ3_4S

Image-Text-to-Text • 36B • Updated 11 days ago • 2.86k • 11

orabazes/wan-14B_vace_phantom_v2_GGUF

17B • Updated Aug 27, 2025 • 94 • 4

AXONVERTEX-AI-RESEARCH/Fara-7B-Q8-GGUF

Image-Text-to-Text • 8B • Updated Nov 25, 2025 • 11 • 2

drbaph/Z-Image-Turbo-FP8

Text-to-Image • Updated Nov 27, 2025 • 13.9k • 48

coughmedicine/Huihui-Qwen3-Next-80B-A3B-Instruct-abliterated-W4A16

Updated Dec 10, 2025 • 10 • 1

Em-80/Qwen3-coder-REAP-25B-A3B-Rust-GGUF

Text Generation • 25B • Updated Mar 26 • 1.11k • 10

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 334 • 14

Tushe/nllb-200-600M-ct2-float16

Translation • Updated Feb 22 • 2 • 1

ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Updated Feb 24 • 10 • 4

Kyworn/pentanet-124m

Updated Mar 27 • 1

zhangsq-nju/Qwen3-1.7B-EdgeRazor-GGUF

Text Generation • 2B • Updated 21 days ago • 1.04k • 10

Krasnopjorovs/gemma-4-31b-it-Imatrix-IQ4_XS-GGUF

Text Generation • Updated Apr 23 • 307 • 3

Krasnopjorovs/gemma-4-26b-a4b-it-Imatrix-IQ4_XS-GGUF

Text Generation • 25B • Updated Apr 23 • 451 • 2

sphaela/Qwen3.6-27B-AutoRound-GGUF

27B • Updated 25 days ago • 5.58k • 16

necroyancer/gemma-4-31B-it-NVFP4-turbo-vision

Image-Text-to-Text • 33B • Updated Apr 26 • 2.65k • 3

manjunathshiva/Nemotron-3-Super-120B-A12B-tq3a-tq2e-g32

Text Generation • 121B • Updated 22 days ago • 3.81k • 1

pearl-ai/Llama-3.3-70B-Instruct-pearl

Text Generation • 71B • Updated Apr 27 • 114k • 3

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated 30 days ago • 3.93k • 7

Accuknoxtechnologies/PII-Qwen3.5-2B-LoRA-8bit

Text Generation • Updated 18 days ago • 27 • 1