Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,096

Base only

Active filters: 2-bit

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-English-128samples-2000randomseed

8B • Updated about 1 month ago • 24

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Indonesian-128samples-1000randomseed

8B • Updated about 1 month ago • 37

RepublicOfKorokke/Qwen3.6-35B-A3B-oQ2e-fp16

35B • Updated about 1 month ago • 26

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Indonesian-128samples-2000randomseed

8B • Updated about 1 month ago • 42

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Tamil-128samples-1000randomseed

8B • Updated about 1 month ago • 29

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Tamil-128samples-2000randomseed

8B • Updated about 1 month ago • 26

bovi1/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated about 1 month ago • 4

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Swahili-128samples-1000randomseed

8B • Updated about 1 month ago • 28

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Swahili-128samples-2000randomseed

8B • Updated about 1 month ago • 27

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Chinese-128samples-2000randomseed

8B • Updated about 1 month ago • 32

Acelogicdev/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated about 1 month ago • 549

fifrio/Qwen3-14B-gptq-2bit-calibration-Swahili-128samples

15B • Updated about 1 month ago • 71

fifrio/Qwen3-14B-gptq-2bit-calibration-Swahili-128samples-1000randomseed

15B • Updated about 1 month ago • 12

fifrio/Qwen3-14B-gptq-2bit-calibration-Swahili-128samples-2000randomseed

15B • Updated about 1 month ago • 5

fifrio/Qwen3-14B-gptq-2bit-calibration-Chinese-128samples

15B • Updated 30 days ago • 63

fifrio/Qwen3-14B-gptq-2bit-calibration-Chinese-128samples-1000randomseed

15B • Updated 30 days ago • 8

fifrio/Qwen3-14B-gptq-2bit-calibration-Chinese-128samples-2000randomseed

15B • Updated 30 days ago • 9

TiGa-RCE/gemma-4-12B-it-oQ2e

12B • Updated 30 days ago • 41

Olt1z/DSV4-Flash-Vision-ablit-EXL3-Kalibrated

Image-Text-to-Text • 64B • Updated 29 days ago • 147 • 1

0xSojalSec/DeepSeek-V4.1-Flash-MLX-MAC

Text Generation • 763B • Updated 29 days ago • 2.12k

UraionLabs/MiniCPM5-2B-oQ2e

Text Generation • 3B • Updated 29 days ago • 148

UraionLabs/MiniCPM5-2B-oQ2.7e

Text Generation • 3B • Updated 29 days ago • 141

UraionLabs/MiniCPM5-2B-oQ2.5e

Text Generation • 3B • Updated 29 days ago • 196

rapid-mlx/DeepSeek-V4.1-Flash-REAP-2bit-MLX

Text Generation • 681B • Updated 5 days ago • 3.72k • 1

mlx-community/DeepSeek-V4.1-Flash-MLX-2bit

763B • Updated 29 days ago • 421

mlx-community/DeepSeek-V4.1-Flash-DSpark-drafter

14B • Updated 29 days ago • 212

treeish/Qwen3.8-27B-oQ2e-MTP-MLX

Image-Text-to-Text • 28B • Updated 29 days ago • 108

fifrio/Llama-3.1-8B-Instruct-gptq-2bit-calibration-Chinese-128samples-1000randomseed

8B • Updated 28 days ago • 43

Finn-Org/FinnAI-Foundation

Image-Text-to-Text • 1B • Updated 28 days ago • 393 • 1

0xSojalSec/Qwen3.8-27B-MLX-2bit

Image-Text-to-Text • 27B • Updated 26 days ago • 150