Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
tensorblock
/
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
like
0
Follow
TensorBlock
311
Transformers
GGUF
deepseek
int4
vllm
llmcompressor
TensorBlock
GGUF
conversational
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF
11.9 MB
Ctrl+K
Ctrl+K
1 contributor
History:
6 commits
morriszms
Keep Q2_K/Q3_K_M gguf only
d9acbea
verified
3 months ago
.gitattributes
Safe
2.61 kB
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q2_K.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-Q3_K_M.gguf
Safe
5.93 MB
xet
Upload folder using huggingface_hub
about 1 year ago
README.md
Safe
7.75 kB
Update README.md
10 months ago