inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq 2B • Updated 7 days ago • 72
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq 2B • Updated 7 days ago • 72
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod 2B • Updated 7 days ago • 18
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod 2B • Updated 7 days ago • 18
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod 5B • Updated 7 days ago • 21
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod 5B • Updated 7 days ago • 21
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq 5B • Updated 7 days ago • 22
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq 5B • Updated 7 days ago • 22