Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,043

Full-text search

Active filters: alignment

Taichi11/sft_v7_dpo_v1_merged

Text Generation • 4B • Updated 3 days ago • 31

Orifusa/dpo-qwen-cot-merged_study11.5.1ya-cot

Text Generation • 4B • Updated 2 days ago • 28

moushi21/dpo-qwen-cot-merged20

Text Generation • 4B • Updated 2 days ago • 30

makotonlo/LLM2026_DPO_SFT19_v8

Text Generation • Updated 2 days ago • 11

Orifusa/dpo-qwen-cot-merged_study11.5.3ya

Text Generation • 4B • Updated 2 days ago • 33

Hi-Satoh/adv_sft3J_dpo_merged

Text Generation • 4B • Updated 2 days ago • 65

Taichi11/sft_v7_dpo_v2_merged

Text Generation • 4B • Updated 2 days ago • 38

WassyO/qwen3-4b-instruct-dpo-from-sft-4096_u-10bei_v5

Text Generation • Updated 2 days ago • 13

Orifusa/dpo-qwen-cot-merged_study11.5.4ya

Text Generation • 4B • Updated 2 days ago • 32

moushi21/dpo-qwen-cot-merged21

Text Generation • 4B • Updated 2 days ago • 27

shinich001/dpo-qwen-cot-merged

Text Generation • 4B • Updated 2 days ago • 102

ogwata/exp19-enhanced-dpo

Text Generation • 4B • Updated 2 days ago • 33

q-hisa/dpo-qwen-cot-merged-v6

Text Generation • 4B • Updated 2 days ago • 52

q-hisa/dpo-qwen-cot-lora-v6

Text Generation • Updated 2 days ago • 7

Orifusa/dpo-qwen-cot-merged_study11.5.5ya

Text Generation • 4B • Updated 2 days ago • 35

Orifusa/dpo-qwen-cot-merged_study11.5.6ya

Text Generation • 4B • Updated 2 days ago • 25

makotonlo/LLM2026_DPO_SFT19_v9

Text Generation • Updated 2 days ago • 18

shinich001/qwen3-4b-seq2k-dpo-merged

Text Generation • 4B • Updated 2 days ago • 27

WassyO/qwen3-4b-instruct-dpo-from-sft-4096_u-10bei_9datasets

Text Generation • Updated 2 days ago • 13

nikeda/dpo-qwen-cot-merged

Text Generation • 4B • Updated 2 days ago • 29

nagayoshi3/dpo-qwen-cot-merged_test1

Text Generation • 4B • Updated 2 days ago • 26

sonodd/qwen3-4b-structeval-dpo-v2-sft-merged

Text Generation • 4B • Updated 2 days ago • 100

sen0808/dpo-qwen-cot-merged

Text Generation • 4B • Updated 1 day ago • 34

Hi-Satoh/adv_sft3J2_dpo_merged

Text Generation • 4B • Updated 1 day ago • 47

moushi21/dpo-qwen-cot-merged22

Text Generation • 4B • Updated 1 day ago • 31

makotonlo/LLM2026_DPO_SFT19_v10

Text Generation • Updated 1 day ago • 11

moushi21/dpo-qwen-cot-merged23

Text Generation • 4B • Updated 1 day ago • 42

takerufukushima/dpo-qwen-cot-merged

Text Generation • 4B • Updated 1 day ago • 31

sak3E/qwen2.5-1.5b-dpo-truthful

Updated about 11 hours ago

takeshi200ok/qwen3-4B-dpo-anti-fence-600

Text Generation • 4B • Updated 1 day ago • 33