Edit Models filters

Model Tree

EleutherAI/pythia-12b

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

26

Base only

Active filters: EleutherAI/pythia-12b

QuantFactory/pythia-12b-GGUF

Text Generation • 12B • Updated Jul 13, 2024 • 827 • 3

OpenVINO/pythia-12b-int8-ov

Text Generation • Updated Nov 5, 2024 • 49

mradermacher/pythia-12b-GGUF

12B • Updated Sep 8, 2024 • 1.16k

mradermacher/pythia-12b-i1-GGUF

12B • Updated Sep 8, 2024 • 411

tensorblock/pythia-12b-GGUF

12B • Updated Jan 27 • 44

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-asym

Text Generation • 2B • Updated Nov 23, 2024 • 1

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs128-sym

Text Generation • 2B • Updated Nov 23, 2024 • 2

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs128-asym

Text Generation • 12B • Updated Dec 7, 2024 • 3

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs128-sym

Text Generation • 12B • Updated Dec 9, 2024 • 3 • 1

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-asym

Text Generation • 12B • Updated Dec 15, 2024 • 1

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs128-sym

Text Generation • 12B • Updated Dec 15, 2024 • 2

newsletter/pythia-12b-Q8_0-GGUF

12B • Updated Dec 30, 2024

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs128-asym

Text Generation • 3B • Updated Feb 15, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs128-sym

Text Generation • 3B • Updated Feb 15, 2025

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs128-asym

Text Generation • 12B • Updated Feb 15, 2025

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs128-sym

Text Generation • 12B • Updated Feb 15, 2025

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs64-asym

Text Generation • 2B • Updated Aug 23, 2025

fbaldassarri/EleutherAI_pythia-12b-autoround-int4-gs64-sym

Text Generation • 2B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-asym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autoawq-int4-gs64-sym

Text Generation • 12B • Updated Aug 23, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-asym

Text Generation • 4B • Updated Aug 23, 2025 • 2

fbaldassarri/EleutherAI_pythia-12b-autoround-int8-gs64-sym

Text Generation • 4B • Updated Aug 24, 2025

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-asym

Text Generation • 12B • Updated Aug 24, 2025 • 1

fbaldassarri/EleutherAI_pythia-12b-autogptq-int8-gs64-sym

Text Generation • 12B • Updated Aug 24, 2025 • 1