Models

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21 • 534k • 41

avtc/GLM-4.6-REAP-268B-A32B-GPTQMODEL-W4A16

Text Generation • 271B • Updated 12 days ago • 237 • 2

TheBloke/Falcon-7B-Instruct-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 135 • 68

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 54.2k • 591

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • 7B • Updated Sep 27, 2023 • 10.4k • 267

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • 47B • Updated Dec 14, 2023 • 334k • 140

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 7B • Updated Dec 11, 2023 • 35.4k • 55

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • 2B • Updated Aug 7, 2024 • 8.94k • 40

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • 74B • Updated Sep 24, 2024 • 398 • 29

shuyuej/Llama-3.3-70B-Instruct-GPTQ

11B • Updated Dec 22, 2024 • 1.06k • 6

empirischtech/DeepSeek-R1-Distill-Qwen-32B-gptq-4bit

Text Generation • 6B • Updated Feb 16 • 1.09k • 5

PrunaAI/TheBloke-Wizard-Vicuna-30B-Uncensored-GPTQ-GGUF-smashed

Updated Feb 19 • 249 • 3

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Mar 20 • 12.9k • 42

MidnightPhreaker/KAT-Dev-72B-Exp-GPTQ-INT4-gs32-0.01

13B • Updated Oct 22 • 10 • 1

ArliAI/GLM-4.6-Derestricted-GPTQ-W4A16

Text Generation • Updated 9 days ago • 1

Rschmaelzle/gpt_quotes

Text Generation • Updated Nov 26, 2022 • 7

sr5434/gptQuotes

Text Generation • 0.3B • Updated Jul 20, 2023 • 19

AlexWortega/gptQARL

Text Generation • Updated Feb 2, 2023 • 9

OccamRazor/pygmalion-6b-gptq-4bit

Text Generation • Updated Apr 3, 2023 • 7 • 10

omarelsayeed/gpt_quran_tafseer2

Text Generation • Updated Mar 23, 2023 • 7

BelleGroup/BELLE-7B-gptq

Text Generation • Updated Apr 20, 2023 • 20 • 26

OccamRazor/pythia-160m-deduped-gptq-4bit

Text Generation • Updated Apr 30, 2023 • 19 • 1

keyfan/chinese-alpaca-7b-gptq

Text Generation • Updated Mar 31, 2023 • 4 • 10

anon8231489123/vicuna-13b-GPTQ-4bit-128g

Text Generation • Updated Apr 7, 2023 • 1.2k • 663

TheBloke/koala-7B-GPTQ

Text Generation • 7B • Updated Aug 21, 2023 • 169 • 31

TheBloke/koala-13B-GPTQ

Text Generation • 13B • Updated Aug 21, 2023 • 38 • 38

4bit/vicuna-13b-GPTQ-4bit-128g

Text Generation • Updated Apr 8, 2023 • 9 • 2

autobots/lotus-12b-gptqv2-4bit

Updated Apr 9, 2023 • 3

TheBloke/galpaca-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 48

autobots/pythia-12b-gptqv2-4bit

Updated Apr 10, 2023 • 2