Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

181

Base only

Active filters: metal

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 4B • Updated 11 days ago • 665k • • 1.09k

prism-ml/Bonsai-27B-gguf

Text Generation • 4B • Updated 11 days ago • 2.34M • 679

badtheorylabs/BTL-3-Compact

Text Generation • 8B • Updated 5 days ago • 1.73k • 31

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated 14 days ago • 40.9k • 189

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated 14 days ago • 32.7k • 154

antirez/deepseek-v4-gguf

Text Generation • 20B • Updated 12 days ago • 654k • 345

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 641k • 110

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 57.5k • 760

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 32.9k • 83

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 14.9k • 53

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated about 1 month ago • 2.29k • 5

mlboydaisuke/Ornith-1.0-9B-CoreAI

Text Generation • Updated 11 days ago • 492 • 2

andreaborio/Qwen3.6-35B-A3B-Hebrus-GGUF

Text Generation • Updated about 8 hours ago • 744 • 1

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

Text Generation • 85B • Updated 6 days ago • 582 • 1

andreaborio/GLM-5.2-Hebrus-GGUF

Text Generation • 260B • Updated 6 days ago • 354 • 1

allemanfredi/inferno-glm-5.2-q2-expertpack

Updated 9 days ago • 1

pyrodog/CyberNeurova-DeepSeek-V4-Flash-abliterated-v2-IQ3_XXS-AS-GGUF

Text Generation • 284B • Updated 4 days ago • 227 • 1

jacklarmer/laguna-s-2.1-mlx-optimized

Text Generation • Updated 1 day ago • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 291 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 20 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 2 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 21 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 134 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 44 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 39 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 59 • 1

halley-ai/gpt-oss-120b-MLX-bf16

Text Generation • 117B • Updated Sep 8, 2025 • 186 • 3

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 60 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 24 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 16 • 1