mlx-community/K2-Horizon-MoVA-36B-A4B-bf16

Text Generation • 37B • Updated 6 days ago • 387

Note Unquantized bf16, 70 GB. For 128 GB Macs.

mlx-community/K2-Horizon-MoVA-36B-A4B-8bit

Text Generation • 37B • Updated 6 days ago • 271 • 1

Note 8-bit, 37 GB, effectively lossless (+0.04% ppl).

mlx-community/K2-Horizon-MoVA-36B-A4B-4bit

Text Generation • 37B • Updated 6 days ago • 564 • 3

Note Mixed 4-bit, 25 GB (+1.2% ppl). For 48 GB+ Macs.

mlx-community/K2-Horizon-7B-bf16

Text Generation • 9B • Updated 5 days ago • 404

Note 7B dense, unquantized bf16, 18 GB. For 32 GB+ Macs.

mlx-community/K2-Horizon-7B-8bit

Text Generation • 9B • Updated 5 days ago • 99

Note 7B dense, 8-bit, 9.6 GB, effectively lossless (+0.2% ppl).

mlx-community/K2-Horizon-7B-4bit

Text Generation • 9B • Updated 5 days ago • 174

Note 7B dense, mixed 4-bit, 7.2 GB (+4.5% ppl). For 16 GB+ Macs.

mlx-community/K2-Horizon-3.7B-bf16

Text Generation • 5B • Updated 5 days ago • 408

Note 3.7B dense, unquantized bf16, 10 GB. For 24 GB+ Macs.

mlx-community/K2-Horizon-3.7B-8bit

Text Generation • 5B • Updated 5 days ago • 87

Note 3.7B dense, 8-bit, 5.4 GB, effectively lossless (-0.04% ppl).

mlx-community/K2-Horizon-3.7B-4bit

Text Generation • 5B • Updated 5 days ago • 169

Note 3.7B dense, mixed 4-bit, 4.2 GB (+4.4% ppl). For 16 GB+ Macs.

mlx-community/K2-Horizon-0.9B-bf16

Text Generation • 1B • Updated 5 days ago • 424

Note 0.9B dense (YaRN, 128K context), unquantized bf16, 2.2 GB.

mlx-community/K2-Horizon-0.9B-8bit

Text Generation • 1B • Updated 5 days ago • 61

Note 0.9B dense, 8-bit, 1.2 GB, effectively lossless (+0.3% ppl).

mlx-community/K2-Horizon-0.9B-4bit

Text Generation • 1B • Updated 5 days ago • 123

Note 0.9B dense, mixed 4-bit, 0.9 GB (+5.6% ppl).