Extreme Compression of Large Language Models via Additive Quantization
Paper
• 2401.06118 • Published
• 14
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)
WARNING: this checkpoint might be obsolete. Please use the updated Mixtral checkpoint.
Official AQLM quantization of mistralai/Mixtral-8x7B-v0.1.
- Downloads last month
- 2