Models

pytorch/gemma-3-12b-it-AWQ-INT4

Any-to-Any • Updated Oct 11 • 27.5k • 1

pytorch/Phi-4-mini-instruct-INT8-INT4

Text Generation • Updated Sep 11 • 1.32k • 2

pytorch/Phi-4-mini-instruct-INT4

Text Generation • Updated Oct 9 • 376

pytorch/Phi-4-mini-instruct-FP8

Text Generation • Updated Oct 9 • 592 • 1

pytorch/Qwen3-8B-INT4

Text Generation • Updated Oct 9 • 346 • 2

pytorch/Qwen3-32B-FP8

Text Generation • Updated Oct 9 • 165

pytorch/Qwen3-4B-INT8-INT4

Text Generation • Updated Sep 11 • 1.19k • 2

pytorch/SmolLM3-3B-INT8-INT4

Text Generation • Updated Sep 11 • 56 • 37

jerryzh168/Qwen3-8B-FP8

Text Generation • Updated Sep 9 • 8

jerryzh168/Qwen3-8B-INT4-non-hqq

Text Generation • Updated Aug 29 • 5

jerryzh168/Qwen3-8B-INT8-INT4

Text Generation • Updated Sep 9 • 7

q10/Qwen3-8B-Base-FP8

Text Generation • Updated Aug 25 • 12

q10/Qwen3-8B-Base-INT4

Text Generation • Updated Aug 25 • 6

q10/Qwen3-8B-Base-INT8-INT4

Text Generation • Updated Aug 25 • 9

pytorch/gemma-3-12b-it-INT4

Any-to-Any • Updated Oct 16 • 936

pytorch/gemma-3-12b-it-FP8

Any-to-Any • Updated Oct 16 • 951

pytorch/gemma-3-27b-it-FP8

Any-to-Any • Updated Oct 17 • 2.23k • 3

pytorch/gemma-3-27b-it-INT4

Any-to-Any • Updated Oct 16 • 916

pytorch/Phi-4-mini-instruct-AWQ-INT4

Text Generation • Updated Oct 9 • 563 • 3

pytorch/Qwen3-8B-AWQ-INT4

Text Generation • Updated Oct 9 • 167 • 1

jerryzh168/Qwen3-8B-INT4

Text Generation • Updated Sep 10 • 13

namgyu-youn/Qwen3-8B-SMOOTHQUANT-W8A8

Text Generation • Updated Sep 17 • 41

namgyu-youn/Phi-4-mini-instruct-AWQ-INT4

Text Generation • Updated Sep 17 • 41

jerryzh168/Qwen3-4B-FP8

Text Generation • Updated Sep 19 • 16

jerryzh168/Qwen3-4B-INT4

Text Generation • Updated Sep 19 • 13

jerryzh168/Qwen3-4B-INT8-INT4

Text Generation • Updated Sep 19 • 13

jerryzh168/gemma-3-12b-it-INT4

Any-to-Any • Updated Oct 11 • 12

jerryzh168/gemma-3-27b-it-INT4

Any-to-Any • Updated Oct 11 • 25

pytorch/gemma-3-27b-it-AWQ-INT4

Any-to-Any • Updated Oct 11 • 973 • 2

pytorch/gemma-3-4b-it-HQQ-INT8-INT4

Any-to-Any • Updated Oct 31 • 68