Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

59

Base only

Active filters: online-dpo, trl

zwangSalesforce/online_dpo

1B • Updated Aug 20, 2024 • 4

lewtun/qwen2-1.5B-lr-3e-6

2B • Updated Aug 25, 2024 • 2

lewtun/qwen2-0.5B-lr-3e-6

0.5B • Updated Aug 25, 2024 • 2

qgallouedec/online-dpo-qwen2-2

Text Generation • 0.5B • Updated Sep 25, 2024 • 3 •

qgallouedec/online-dpo-qwen2-3

Text Generation • 0.5B • Updated Sep 25, 2024 • 4 •

qgallouedec/online-dpo-qwen2-4

Text Generation • 0.5B • Updated Sep 25, 2024 • 3 •

ikimhope/pythia-1b-tldr-online-dpo-mark-peft

Updated Oct 7, 2024

trl-lib/Qwen2-0.5B-OnlineDPO

Text Generation • 0.5B • Updated Oct 23, 2024 • 7 • • 1

mradermacher/Qwen2-0.5B-OnlineDPO-GGUF

0.5B • Updated Oct 24, 2024 • 41

qgallouedec/Qwen2-0.5B-OnlineDPO-GRM-Gemma

Text Generation • 0.5B • Updated Oct 25, 2024 • 3 •

qgallouedec/Qwen2-0.5B-OnlineDPO-PairRM

Text Generation • 0.5B • Updated Oct 25, 2024 • 4

qgallouedec/Qwen2-0.5B-OnlineDPO-AutoRM

Text Generation • 0.5B • Updated Oct 28, 2024 • 4 •

AlekseyKorshuk/ai-detection-gutenberg-human-formatted-ai-v1-sft-qwen-3b-online-dpo-3epochs

Text Generation • 3B • Updated Nov 2, 2024 • 3

AlekseyKorshuk/ai-detection-gutenberg-human-choosed-formatted-ai-sft-qwen-7b-online-dpo-3epochs

Text Generation • 3B • Updated Nov 4, 2024 • 4

XueyingJia/pythia-1b-deduped-tldr-online-dpo

Updated Nov 24, 2024

XueyingJia/pythia-1b-deduped-hh-online-dpo

Text Generation • Updated Nov 24, 2024 • 3

XueyingJia/pythia-1b-deduped-hh-online-dpo-full

Updated Nov 25, 2024

XueyingJia/pythia160m-tldrsft-hh-online-dpo

Updated Nov 24, 2024

Audreygyj/pythia-160m-online-dpo-SG

Updated Dec 7, 2024

Audreygyj/pythia-160m-online-dpo-SG_test

Updated Dec 6, 2024

XueyingJia/pythia-1b-online-dpo-HH-merge-rewardmodel

Updated Dec 8, 2024

Audreygyj/pythia-160m-online-dpo-HH-2

Updated Dec 9, 2024

XueyingJia/pythia-1b-online-dpo-SG-merge-llama-judge-test-resume

Updated Dec 8, 2024

XueyingJia/pythia-1b-online-dpo-HH-merge-rewardmodel-resume

Updated Dec 8, 2024

XueyingJia/pythia-160m-online-dpo-SG-3

Updated Dec 8, 2024

XueyingJia/pythia-1b-online-dpo-HH-merge-rewardmodel-resume-2

Updated Dec 8, 2024

XueyingJia/pythia-1b-online-dpo-HH-merge-rewardmodel-duplicated

Updated Dec 8, 2024

XueyingJia/pythia-1b-online-dpo-SG-merge-sfairXC-judge

Updated Dec 9, 2024

XueyingJia/pythia-1b-online-dpo-ground-truth-lead

Updated Dec 10, 2024

XueyingJia/pythia-160m-online-dpo-ground-truth-lead

Updated Dec 9, 2024