Edge-Quant/granite-4.0-micro-Q4_K_M-GGUF
3B • Updated
• 9
2. Mid-Range Devices Llm models
4-8 GB RAM
-
-
Edge-Quant/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 9 -
Edge-Quant/gemma-3n-E2B-it-Q4_K_M-GGUF
Image-Text-to-Text • 4B • Updated • 27 • 1 -
Edge-Quant/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 10 -
Edge-Quant/VibeThinker-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated -
Edge-Quant/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 22 -
Edge-Quant/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 13 -
Edge-Quant/Gemmasutra-Mini-2B-v1-Q4_K_M-GGUF
3B • Updated • 109 • 2 -
Edge-Quant/AFM-4.5B-Q4_K_M-GGUF
5B • Updated • 8 -
Edge-Quant/Hunyuan-4B-Instruct-Q4_K_M-GGUF
4B • Updated • 11 -
Edge-Quant/Ministral-3b-instruct-Q4_K_M-GGUF
Text Generation • 3B • Updated • 6 -
Edge-Quant/Ministral-3-3B-Reasoning-2512-Q4_K_M-GGUF
3B • Updated • 2 -
Edge-Quant/SmallThinker-3B-Preview-Q4_K_M-GGUF
Text Generation • 3B • Updated • 6 -
Edge-Quant/SmallThinker-4BA0.6B-Instruct-Q4_K_M-GGUF
Text Generation • 4B • Updated • 10 -
Edge-Quant/SmolLM3-3B-Q4_K_M-GGUF
3B • Updated • 9 -
Edge-Quant/Qwen3-4B-Instruct-2507-Q4_K_M-GGUF
Text Generation • 4B • Updated • 7 -
Edge-Quant/Jan-v1-4B-Q4_K_M-GGUF
Text Generation • 4B • Updated • 13 -
Edge-Quant/sarvam-1-Q4_K_M-GGUF
3B • Updated • 10 -
Edge-Quant/Nanbeige4-3B-Thinking-2511-Q4_K_M-GGUF
Text Generation • 4B • Updated • 32 -
Edge-Quant/Dolphin-v2-Q4_K_M-GGUF
Image-Text-to-Text • 3B • Updated • 33 -
Edge-Quant/YuLan-Mini-Q4_K_M-GGUF
Text Generation • 2B • Updated • 11 -
zhiyuan8/RWKV-v7-1.5B-G1-GGUF
Text Generation • 2B • Updated • 83 • 2 -
zhiyuan8/RWKV-v7-2.9B-G1-GGUF
Text Generation • 3B • Updated • 68 • 2 -
Edge-Quant/OpenReasoning-Nemotron-1.5B-Q4_K_M-GGUF
Text Generation • 2B • Updated • 6