Running 62 Accurate GGUF VRAM Calculator 📊 62 Calculate VRAM for GGUF models using GPU layers and context
kaetemi/Meta-Llama-3.1-8B-Q4_K_M-GGUF-old Text Generation • 8B • Updated Jul 23, 2024 • 13 • 2
Running Featured 1.04k Can You Run It? LLM version 🚀 1.04k Calculate GPU needs for running LLMs on your hardware