-
QuantFactory/granite-3.0-1b-a400m-base-GGUF
Text Generation • 1B • Updated • 353 • 4 -
QuantFactory/granite-3.0-1b-a400m-instruct-GGUF
Text Generation • 1B • Updated • 647 • 4 -
QuantFactory/granite-3.0-8b-instruct-GGUF
Text Generation • 8B • Updated • 251 • 2 -
QuantFactory/granite-3.0-2b-base-GGUF
Text Generation • 3B • Updated • 152 • 2
AI & ML interests
None defined yet.
Collection of quantized version of Llama 3.2 models
-
QuantFactory/Llama-3.2-1B-GGUF
Text Generation • 1B • Updated • 920 • 10 -
QuantFactory/Llama-3.2-3B-GGUF
Text Generation • 3B • Updated • 639 • 16 -
QuantFactory/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 1.43k • 6 -
QuantFactory/Llama-3.2-3B-Instruct-GGUF
Text Generation • 3B • Updated • 1.17k • 16
Quantized versions of models by mistralai
-
QuantFactory/Mistral-Nemo-Instruct-2407-GGUF
12B • Updated • 79k • 50 -
QuantFactory/Mistral-Nemo-Base-2407-GGUF
12B • Updated • 741 • 20 -
QuantFactory/Mistral-Ita-7b-GGUF
Text Generation • 7B • Updated • 446 -
QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF
Text Generation • 7B • Updated • 107 • 2
-
QuantFactory/Qwen2-7B-GGUF
Text Generation • 8B • Updated • 375 • 3 -
QuantFactory/Qwen2-7B-Instruct-GGUF
Text Generation • 8B • Updated • 379 • 3 -
QuantFactory/Qwen2-1.5B-GGUF
Text Generation • 2B • Updated • 371 • 3 -
QuantFactory/Qwen2-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 514 • 1
-
QuantFactory/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation • 8B • Updated • 44.7k • 17 -
QuantFactory/Meta-Llama-3.1-8B-GGUF
Text Generation • 8B • Updated • 1.34k • 13 -
QuantFactory/Meta-Llama-3.1-8B-Claude-GGUF
8B • Updated • 563 • 1 -
QuantFactory/Meta-Llama-3-120B-Instruct-GGUF
Text Generation • 122B • Updated • 107 • 12
Space for requesting quants for models.
Collection of quantized versions of the latest Qwen 2.5 models
-
QuantFactory/Qwen2.5-0.5B-GGUF
Text Generation • 0.5B • Updated • 650 • 5 -
QuantFactory/Qwen2.5-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 477 • 2 -
QuantFactory/Qwen2.5-1.5B-GGUF
Text Generation • 2B • Updated • 280 • 1 -
QuantFactory/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 1.81k • 2
Quantizations of llama-3 models
-
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF
Text Generation • 8B • Updated • 23.4k • 323 -
QuantFactory/Meta-Llama-3-8B-GGUF
Text Generation • 8B • Updated • 2.73k • 112 -
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2
Text Generation • 8B • Updated • 713 • 15 -
QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2
Text Generation • 71B • Updated • 761 • 16
Quantizations of ArliAI-Llama-3 models
-
QuantFactory/ArliAI-Llama-3-8B-Formax-v1.0-GGUF
Text Generation • 8B • Updated • 387 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Argon-v1.0-GGUF
Text Generation • 8B • Updated • 451 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Cumulus-v0.2-GGUF
Text Generation • 8B • Updated • 392 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF
Text Generation • 8B • Updated • 417 • 1
-
QuantFactory/granite-3.0-1b-a400m-base-GGUF
Text Generation • 1B • Updated • 353 • 4 -
QuantFactory/granite-3.0-1b-a400m-instruct-GGUF
Text Generation • 1B • Updated • 647 • 4 -
QuantFactory/granite-3.0-8b-instruct-GGUF
Text Generation • 8B • Updated • 251 • 2 -
QuantFactory/granite-3.0-2b-base-GGUF
Text Generation • 3B • Updated • 152 • 2
Space for requesting quants for models.
Collection of quantized version of Llama 3.2 models
-
QuantFactory/Llama-3.2-1B-GGUF
Text Generation • 1B • Updated • 920 • 10 -
QuantFactory/Llama-3.2-3B-GGUF
Text Generation • 3B • Updated • 639 • 16 -
QuantFactory/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 1.43k • 6 -
QuantFactory/Llama-3.2-3B-Instruct-GGUF
Text Generation • 3B • Updated • 1.17k • 16
Collection of quantized versions of the latest Qwen 2.5 models
-
QuantFactory/Qwen2.5-0.5B-GGUF
Text Generation • 0.5B • Updated • 650 • 5 -
QuantFactory/Qwen2.5-0.5B-Instruct-GGUF
Text Generation • 0.5B • Updated • 477 • 2 -
QuantFactory/Qwen2.5-1.5B-GGUF
Text Generation • 2B • Updated • 280 • 1 -
QuantFactory/Qwen2.5-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 1.81k • 2
Quantized versions of models by mistralai
-
QuantFactory/Mistral-Nemo-Instruct-2407-GGUF
12B • Updated • 79k • 50 -
QuantFactory/Mistral-Nemo-Base-2407-GGUF
12B • Updated • 741 • 20 -
QuantFactory/Mistral-Ita-7b-GGUF
Text Generation • 7B • Updated • 446 -
QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF
Text Generation • 7B • Updated • 107 • 2
Quantizations of llama-3 models
-
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF
Text Generation • 8B • Updated • 23.4k • 323 -
QuantFactory/Meta-Llama-3-8B-GGUF
Text Generation • 8B • Updated • 2.73k • 112 -
QuantFactory/Meta-Llama-3-8B-Instruct-GGUF-v2
Text Generation • 8B • Updated • 713 • 15 -
QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2
Text Generation • 71B • Updated • 761 • 16
-
QuantFactory/Qwen2-7B-GGUF
Text Generation • 8B • Updated • 375 • 3 -
QuantFactory/Qwen2-7B-Instruct-GGUF
Text Generation • 8B • Updated • 379 • 3 -
QuantFactory/Qwen2-1.5B-GGUF
Text Generation • 2B • Updated • 371 • 3 -
QuantFactory/Qwen2-1.5B-Instruct-GGUF
Text Generation • 2B • Updated • 514 • 1
Quantizations of ArliAI-Llama-3 models
-
QuantFactory/ArliAI-Llama-3-8B-Formax-v1.0-GGUF
Text Generation • 8B • Updated • 387 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Argon-v1.0-GGUF
Text Generation • 8B • Updated • 451 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Cumulus-v0.2-GGUF
Text Generation • 8B • Updated • 392 • 1 -
QuantFactory/ArliAI-Llama-3-8B-Instruct-Dolfin-v0.1-GGUF
Text Generation • 8B • Updated • 417 • 1
-
QuantFactory/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation • 8B • Updated • 44.7k • 17 -
QuantFactory/Meta-Llama-3.1-8B-GGUF
Text Generation • 8B • Updated • 1.34k • 13 -
QuantFactory/Meta-Llama-3.1-8B-Claude-GGUF
8B • Updated • 563 • 1 -
QuantFactory/Meta-Llama-3-120B-Instruct-GGUF
Text Generation • 122B • Updated • 107 • 12