GGUF-5G-SPLIT DanyDA/phind-codellama-34b-v2.Q4_K_M-GGUF-SPLIT 34B • Updated Jul 14, 2025 • 15 DanyDA/Devstral-Small-2507-Q4_K_M-GGUF-SPLIT 24B • Updated Jul 16, 2025 • 1 DanyDA/Magistral-Small-2506-Q4_K_M-GGUF-SPLIT 24B • Updated Jul 4, 2025
exllamav3 exllamav3 aka exl3 quantizations. See https://github.com/turboderp-org/exllamav3 DanyDA/Qwen3-32B-exl3-2.0bpw Text Generation • 5B • Updated May 2, 2025 • 1 DanyDA/Qwen3-32B-exl3-4.0bpw Text Generation • 9B • Updated May 2, 2025 • 2 DanyDA/Mellum-4b-base-exl3-6.0bpw Text Generation • Updated May 14, 2025 • 3 DanyDA/Mellum-4b-base-exl3-8.0bpw Text Generation • Updated May 14, 2025 • 2
GGUF-5G-SPLIT DanyDA/phind-codellama-34b-v2.Q4_K_M-GGUF-SPLIT 34B • Updated Jul 14, 2025 • 15 DanyDA/Devstral-Small-2507-Q4_K_M-GGUF-SPLIT 24B • Updated Jul 16, 2025 • 1 DanyDA/Magistral-Small-2506-Q4_K_M-GGUF-SPLIT 24B • Updated Jul 4, 2025
exllamav3 exllamav3 aka exl3 quantizations. See https://github.com/turboderp-org/exllamav3 DanyDA/Qwen3-32B-exl3-2.0bpw Text Generation • 5B • Updated May 2, 2025 • 1 DanyDA/Qwen3-32B-exl3-4.0bpw Text Generation • 9B • Updated May 2, 2025 • 2 DanyDA/Mellum-4b-base-exl3-6.0bpw Text Generation • Updated May 14, 2025 • 3 DanyDA/Mellum-4b-base-exl3-8.0bpw Text Generation • Updated May 14, 2025 • 2