Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

98

Base only

Active filters: metal

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 7 days ago • 781k • 228

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated about 3 hours ago • 18.7k • 41

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 57.7k • 710

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 7.62k • 46

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 9.97k • 74

zlaabsi/Qwen3.6-27B-OTQ-GGUF

Image-Text-to-Text • 27B • Updated May 2 • 2.22k • 25

anemll/DeepSeek-V4-Flash-FP4-FP8-SSD

Text Generation • 7B • Updated Apr 29 • 2.03k • 6

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_mlx

Text Generation • 21B • Updated May 2 • 1.23k • 3

6ms/DeepSeek-V4-Flash-MXFP4-GGUF

Text Generation • 284B • Updated 24 days ago • 1.42k • 1

osmapi/SANA-WM-Bidirectional-on-Apple-Silicon

Image-to-Video • Updated 18 days ago • 5

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLXFP4

Image-Text-to-Text • 4B • Updated about 14 hours ago • 216 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLX-8bit

Image-Text-to-Text • 4B • Updated about 14 hours ago • 202 • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 180 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 62 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 15 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 8 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 271 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 65 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 63 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 86 • 1

halley-ai/gpt-oss-120b-MLX-bf16

Text Generation • 117B • Updated Sep 8, 2025 • 397 • 3

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 156 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 39 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 18 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 11 • 1

JeffersonNunn/metal-flash-attention-bridge

Updated Oct 23, 2025

JeffersonNunn/deepseek-ocr-metal

Updated Oct 23, 2025 • 4

Dogacel/DeepSeek-OCR-Metal-MPS

Image-Text-to-Text • 3B • Updated Dec 24, 2025 • 77 • 13

LibraxisAI/whisper-large-v3-turbo-mlx-q8

Automatic Speech Recognition • Updated 27 days ago • 189

CrazeDigger/htdemucs

Audio-to-Audio • Updated Jan 12