Edge-Quant/granite-4.0-micro-Q4_K_M-GGUF
3B
•
Updated
•
26
2. Mid-Range Devices Llm models
4-8 GB RAM
-
-
Edge-Quant/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 20 -
Edge-Quant/gemma-3n-E2B-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 162 • 1 -
Edge-Quant/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 31 -
Edge-Quant/VibeThinker-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 19 -
Edge-Quant/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 58 -
Edge-Quant/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 23 -
Edge-Quant/Gemmasutra-Mini-2B-v1-Q4_K_M-GGUF
3B • Updated • 134 • 1 -
Edge-Quant/AFM-4.5B-Q4_K_M-GGUF
5B • Updated • 54 -
Edge-Quant/Hunyuan-4B-Instruct-Q4_K_M-GGUF
4B • Updated • 27 -
Edge-Quant/Ministral-3b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 33 -
Edge-Quant/Ministral-3-3B-Reasoning-2512-Q4_K_M-GGUF
3B • Updated • 61 -
Edge-Quant/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation • 3B • Updated • 23 -
Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 28 -
Edge-Quant/SmolLM3-3B-Q4_K_M-GGUF
3B • Updated • 84 -
Edge-Quant/Qwen3-4B-Instruct-2507-Q4_K_M-GGUF
Text Generation • 4B • Updated • 24 -
Edge-Quant/Jan-v1-4B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 43 -
Edge-Quant/sarvam-1-Q4_K_M-GGUF
3B • Updated • 35 -
Edge-Quant/Nanbeige4-3B-Thinking-2511-Q4_K_M-GGUF
Text Generation • 4B • Updated • 45 -
Edge-Quant/Dolphin-v2-Q4_K_M-GGUF
Image-Text-to-Text • 3B • Updated • 54 -
Edge-Quant/YuLan-Mini-Q4_K_M-GGUF
Text Generation • 2B • Updated • 11 -
zhiyuan8/RWKV-v7-1.5B-G1-GGUF
Text Generation • 2B • Updated • 124 • 2 -
zhiyuan8/RWKV-v7-2.9B-G1-GGUF
Text Generation • 3B • Updated • 70 • 2 -
Edge-Quant/OpenReasoning-Nemotron-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 28