Models

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 5B • Updated May 21 • 534k • 41

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 4B • Updated Sep 27, 2023 • 51.2k • 591

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated 11 days ago • 237 • 2

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 6B • Updated Dec 14, 2023 • 334k • 140

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 8.94k • 40

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • 13B • Updated Sep 24, 2024 • 398 • 29

shuyuej/Llama-3.3-70B-Instruct-GPTQ

11B • Updated Dec 22, 2024 • 1.06k • 6

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • 6B • Updated Feb 16 • 1.09k • 5

PrunaAI/TheBloke-Wizard-Vicuna-30B-Uncensored-GPTQ-GGUF-smashed

Updated Feb 19 • 249 • 3

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 12.9k • 42

QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int8

Text Generation • 11B • Updated Sep 15 • 162 • 3

QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int4

Text Generation • 6B • Updated Sep 15 • 80 • 5

MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32-0.01

13B • Updated Oct 22 • 10 • 1

ArliAI/GLM-4.6-Derestricted-GPTQ-W4A16

Text Generation • Updated 8 days ago • 1

Rschmaelzle/gpt_quotes

Text Generation • Updated Nov 26, 2022 • 7

sr5434/gptQuotes

Text Generation • 0.3B • Updated Jul 20, 2023 • 18

AlexWortega/gptQARL

Text Generation • Updated Feb 2, 2023 • 9

OccamRazor/pygmalion-6b-gptq-4bit

Text Generation • Updated Apr 3, 2023 • 7 • 10

omarelsayeed/gpt_quran_tafseer2

Text Generation • Updated Mar 23, 2023 • 8

BelleGroup/BELLE-7B-gptq

Text Generation • Updated Apr 20, 2023 • 19 • 26

OccamRazor/pythia-160m-deduped-gptq-4bit

Text Generation • Updated Apr 30, 2023 • 19 • 1

keyfan/chinese-alpaca-7b-gptq

Text Generation • Updated Mar 31, 2023 • 4 • 10

anon8231489123/vicuna-13b-GPTQ-4bit-128g

Text Generation • Updated Apr 7, 2023 • 1.19k • 663

TheBloke/koala-7B-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 168 • 31

TheBloke/koala-13B-GPTQ

Text Generation • 2B • Updated Aug 21, 2023 • 40 • 38

4bit/vicuna-13b-GPTQ-4bit-128g

Text Generation • Updated Apr 8, 2023 • 9 • 2

autobots/lotus-12b-gptqv2-4bit

Updated Apr 9, 2023 • 3

TheBloke/galpaca-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 48

autobots/pythia-12b-gptqv2-4bit

Updated Apr 10, 2023 • 2

TheBloke/vicuna-7B-v0-GPTQ

Text Generation • 1B • Updated Aug 21, 2023 • 33 • 15