Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,270

Base only

Active filters: fp8

Pyroserenus/Orthrus-12b-v0.8-FP8

12B • Updated Aug 7, 2024 • 3

CalamitousFelicitousness/L3.1-70B-sunfall-v0.6.1-fp8-dynamic

71B • Updated Aug 8, 2024 • 5

John6666/goddess-of-realism-gor-pony-v2art-sdxl

Text-to-Image • Updated Aug 9, 2024 • 2

ajinkya-tejankar/Mistral-7B-Instruct-v0.2-FP8

7B • Updated Aug 12, 2024 • 2

ajinkya-tejankar/Mistral-7B-v0.1-FP8

7B • Updated Aug 12, 2024 • 2

akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic

Text Generation • 8B • Updated Aug 21, 2024 • 13 • 14

Infermatic/goliath-120b-Instruct-FP8-Dynamic

Text Generation • 118B • Updated Aug 13, 2024 • 6

Infermatic/Llama-3-Lumimaid-70B-v0.1-Instruct-FP8-Dynamic

71B • Updated Aug 13, 2024 • 4

juliensimon/Arcee-Nova-fp8

Text Generation • 73B • Updated Mar 22 • 9

juliensimon/Llama-Spark-fp8

Text Generation • 8B • Updated Mar 22 • 12

CalamitousFelicitousness/Hermes-3-Llama-3.1-70B-fp8-dynamic

71B • Updated Sep 13, 2024 • 8

Pyroserenus/Chronos-Gold-12B-1.0-FP8

12B • Updated Aug 21, 2024 • 2

John6666/fluxunchained-artfulnsfw-fut516xfp8e4m3fnv11-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 11 • 2

John6666/nepotism-fuxdevschnell-v3aio-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 4

John6666/blue-pencil-flux1-v001-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 5

John6666/the-araminta-flux1a1-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 3

John6666/acorn-is-spinning-flux-v11-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 5 • 2

John6666/copycat-flux-test-fp8-v11-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 3

John6666/fluxescore-dev-v10fp16-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 5

John6666/niji-style-flux-devfp8-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 1

CalamitousFelicitousness/L3.1-70B-Euryale-v2.2-fp8-dynamic

71B • Updated Aug 25, 2024 • 4

CalamitousFelicitousness/magnum-v2-72b-fp8-dynamic

73B • Updated Aug 25, 2024 • 4

John6666/fastflux-unchained-t5f16-fp8-flux

Text-to-Image • Updated Aug 26, 2024 • 2 • 1

speakleash/Bielik-11B-v2.2-Instruct-FP8

Text Generation • 11B • Updated Jun 6, 2025 • 101 • 3

CalamitousFelicitousness/gemma-2-27b-fp8-dynamic

27B • Updated Aug 26, 2024 • 10

CalamitousFelicitousness/gemma-2-27b-it-fp8-dynamic

27B • Updated Aug 26, 2024 • 7

CalamitousFelicitousness/gemma-2-9b-fp8-dynamic

9B • Updated Aug 26, 2024 • 1 • 1

CalamitousFelicitousness/gemma-2-9b-it-fp8-dynamic

9B • Updated Aug 26, 2024 • 4

CalamitousFelicitousness/gemma-2-27b-it-fp8-dynamic-rope

27B • Updated Aug 26, 2024 • 8 • 1

Infermatic/magnum-v2-72b-FP8-Dynamic

Text Generation • 73B • Updated Aug 27, 2024 • 1 • 1