Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,636

Base only

Active filters: exl3

UnstableLlama/Semancer-12B

12B • Updated 18 days ago • 243 • 5

brandonmusic/GLM-5.2-NVFP4-TR3-Hybrid

Text Generation • Updated about 15 hours ago • 338 • 3

turboderp/Qwen3.6-27B-exl3

Updated about 18 hours ago • 7 • 3

turboderp/Qwen3.6-27B-exl3_3.30bpw

Image-Text-to-Text • 7B • Updated 17 days ago • 69 • 3

turboderp/gemma-4-12B-it-exl3

Updated Jun 5 • 159 • 7

UnstableLlama/gemma-4-12B-it-desiccated

12B • Updated Jun 11 • 14 • 6

blockblockblock/openPangu-2.0-Flash-exl3-4.0bpw

Text Generation • 25B • Updated 10 days ago • 421 • 2

dr-housemd/Tess-4-27B-8bpw-exl3

Image-Text-to-Text • 15B • Updated 3 days ago • 32 • 1

SicariusSicariiStuff/Impish_QWEN_14B-1M-8.0bpw

8B • Updated Aug 16, 2025 • 1

turboderp/Phi-4-mini-instruct-exl3

Updated Nov 1, 2025 • 15 • 1

turboderp/Llama-3.2-1B-Instruct-exl3

Updated Nov 1, 2025 • 17 • 1

turboderp/Qwen2.5-7B-Instruct-exl3

Updated Nov 1, 2025 • 11 • 2

turboderp/Qwen2.5-14B-Instruct-exl3

Updated Nov 1, 2025 • 21 • 2

turboderp/Mistral-7B-Instruct-v0.3-exl3

Updated Nov 1, 2025 • 13 • 1

turboderp/Llama-3.1-8B-Instruct-exl3

Updated Nov 1, 2025 • 15 • 3

turboderp/Llama-3.1-70B-Instruct-exl3

Updated Nov 1, 2025 • 11 • 1

turboderp/gemma-2-9b-it-exl3

Updated Nov 1, 2025 • 10 • 1

turboderp/Mistral-Large-Instruct-2411-exl3

Updated Nov 1, 2025 • 27 • 10

MikeRoz/mistralai_Mistral-Large-Instruct-2411-8.0bpw-h8-exl3

62B • Updated Apr 8, 2025 • 8

MikeRoz/Meta-Llama-3.1-405B-Instruct-2.0bpw-h4-exl3

Text Generation • 53B • Updated Apr 9, 2025 • 3 • 1

async0x42/QwQ-32B-abliterated-exl3_4.5bpw

Text Generation • 10B • Updated Apr 10, 2025 • 9 • 1

bullerwins/Llama-3.3-70B-Instruct-exl3-4.58bpw

Text Generation • 21B • Updated Apr 10, 2025 • 4

bullerwins/Llama-3.3-70B-Instruct-exl3-4.03bpw

Text Generation • 19B • Updated Apr 10, 2025 • 5

Jellon/Lyra-Gutenberg-12b-exl3-6bpw

Text Generation • 5B • Updated Apr 10, 2025 • 5 • 1

Jellon/Lyra-Gutenberg-12b-exl3-4bpw

Text Generation • 4B • Updated Apr 10, 2025 • 5

Volko76/Llama-3.2-1B-Instruct-exl3

Updated Apr 10, 2025 • 2

Volko76/Qwen2.5-Coder-0.5B-Instruct-exl3

Text Generation • Updated Apr 10, 2025 • 7 • 1

Volko76/Lucie-7B-Instruct-abliterated-exl3

Updated Apr 10, 2025 • 2

async0x42/cogito-v1-preview-qwen-32B-exl3_4.5bpw

Text Generation • 10B • Updated Apr 11, 2025 • 7

async0x42/DeepCoder-1.5B-Preview-exl3_4.5bpw

Text Generation • Updated Apr 11, 2025 • 5