Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,456

Full-text search

Active filters: 6-bit

mlx-community/Olmo-3-1025-7B-6bit

Text Generation • Updated Nov 21, 2025 • 1

mlx-community/Olmo-3-1125-32B-6bit

Text Generation • Updated Nov 21, 2025 • 3

Plurigrid/DR-Tulu-8B-MLX-6bit

8B • Updated Nov 22, 2025 • 8

garrison/Snowpiercer-15B-v4-mlx-6Bit

15B • Updated Nov 23, 2025 • 10

mlx-community/GLM-4.6-6bit

Text Generation • 353B • Updated Nov 23, 2025 • 11

DeathGodlike/Sunlit-Shadow-12B_EXL3

Text Generation • Updated Nov 23, 2025

DeathGodlike/Starfallen-Snow-Fantasy-24B-MS3.2-v0.0_EXL3

Text Generation • Updated Nov 24, 2025

DeathGodlike/Strawberry-Smoothie-12B-Model-Stock_EXL3

Text Generation • Updated Nov 24, 2025 • 5

garrison/GLM-4.5-Air-Derestricted-mlx-6Bit

Text Generation • 107B • Updated Nov 24, 2025 • 27 • 1

DeathGodlike/ThetaBlackGorgon-8B_EXL3

Text Generation • Updated Dec 7, 2025 • 1

mlx-community/Josiefied-Olmo-3-7B-Instruct-abliterated-v1-6bit

Text Generation • 7B • Updated Nov 25, 2025 • 6

mlx-community/Olmo-3-7B-RLZero-Code-6bit

Text Generation • Updated Nov 25, 2025 • 10

DeathGodlike/LemonadeRP-4.5.3_EXL3

Text Generation • Updated Nov 26, 2025 • 3

mlx-community/LLaDA2.0-mini-6bit

Text Generation • 16B • Updated Nov 26, 2025 • 24

mlx-community/LLaDA2.0-flash-6bit

Text Generation • 103B • Updated Nov 26, 2025 • 21

DeathGodlike/WinterEngine-24B-Instruct_EXL3

Text Generation • Updated Nov 26, 2025

DeathGodlike/Scarlet-Seraph-12B_EXL3

Text Generation • Updated Nov 26, 2025

mlx-community/INTELLECT-3-6bit

Text Generation • 107B • Updated Nov 27, 2025 • 22

DeathGodlike/Silvertongue-V3_EXL3

Text Generation • Updated Dec 7, 2025 • 2

DeathGodlike/The-Creeping-Darkness-X2-16B_EXL3

Text Generation • Updated Dec 7, 2025

Wwayu/GLM-4.5-Air-Derestricted-mlx-6Bit

Text Generation • Updated Nov 27, 2025 • 31

MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF

Text Generation • 12B • Updated Nov 28, 2025 • 51.1k • 2

MaziyarPanahi/Olmo-3-32B-Think-GGUF

Text Generation • 32B • Updated Nov 28, 2025 • 17

MaziyarPanahi/Olmo-3-7B-Think-GGUF

Text Generation • 7B • Updated Nov 28, 2025 • 19

MaziyarPanahi/Olmo-3-7B-Instruct-GGUF

Text Generation • 7B • Updated Nov 28, 2025 • 25

DeathGodlike/DarkForest-20B-v2.0-Erebus-Edition_EXL3

Text Generation • Updated Nov 28, 2025 • 3

mlx-community/Orchestrator-8B-6bit

Text Generation • Updated Nov 29, 2025 • 3

MaziyarPanahi/NVIDIA-Nemotron-Nano-9B-v2-GGUF

Text Generation • 9B • Updated Nov 29, 2025 • 389 • 3

DeathGodlike/Sexpedition-MS3.2-24B_EXL3

Text Generation • Updated Dec 7, 2025 • 1

introvoyz041/Devstral-Small-2505-MLX-6bit-mlx-4Bit

Text Generation • 24B • Updated Nov 30, 2025 • 22