Inference Providers
Active filters: 3-bit
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 115k
• 7
Text Generation
• 15B • Updated • 116k
• 7
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
• 24B • Updated • 117k
• 10
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
• 2B • Updated • 178k
• 7
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 121k
• 2
MaziyarPanahi/LFM2-24B-A2B-GGUF
Text Generation
• 24B • Updated • 499
• 2
andrevp/Qwen3.5-35B-A3B-MLX-VLM-3bit
Image-Text-to-Text
• 5B • Updated • 626
• 2
RepublicOfKorokke/Qwen3.5-27B-mlx-lm-3bit
Text Generation
• 27B • Updated • 238
• 1
MetaphoricalCode/Qwen3.5-27B-heretic-v2-exl3-3bpw-hb6
Text Generation
• 7B • Updated • 37
• 1
Brooooooklyn/qwen3.5-9B-unsloth-mlx
Text Generation
• 4B • Updated • 110
• 1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 13
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 7
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 8
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 4
Text Generation
• Updated • 4
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 3
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
• 6B • Updated • 2
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
• 6B • Updated • 3
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
• 3B • Updated • 2
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
• 3B • Updated • 2
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
• 31B • Updated • 1
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
• 65B • Updated • 3
SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT
Text Generation
• 31B • Updated • 3
kaitchup/Mistral-7B-v0.1-gptq-3bit
Text Generation
• 7B • Updated • 4
kaitchup/Llama-2-13b-hf-gptq-3bit
Text Generation
• 12B • Updated • 4
kaitchup/Llama-2-7b-hf-gptq-3bit
Text Generation
• 6B • Updated • 763
• 1
Text Generation
• 3B • Updated • 150
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 205
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 78
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 218
• 5