Extreme Compression of Large Language Models via Additive Quantization
Paper
• 2401.06118 • Published
• 14
YAML Metadata Warning: empty or missing yaml metadata in repo card
Check out the documentation for more information.
WARNING: this checkpoint might be obsolete. Please use the updated Mixtral checkpoint.
Official AQLM quantization of mistralai/Mixtral-8x7B-v0.1.
- Downloads last month
- 6