Running Agents 67 Accurate GGUF Memory Calculator 📊 67 Calculate memory for GGUF models using GPU layers + context
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-old Text Generation • 8B • Updated Jul 23, 2024 • 30 • 2
Running Featured 1.05k Can You Run It? LLM version 🚀 1.05k Calculate GPU needs for running LLMs on your hardware