Models

silviasapora/gemma-7b-colpo-basic_capibara-5e-5-005-v145

Updated May 13

silviasapora/mistral-7b-colpo-basic-5e-5-005-v147

Updated May 13

silviasapora/mistral-7b-colpo-basic-5e-5-005-v148

Updated May 13

obiwit/llama3.2-3b-orpo-vanilla

Text Generation • 3B • Updated May 17 • 1

silviasapora/mistral-7b-colpo-basic-5e-5-005-v149

Updated May 14

BKM1804/Qwen2.5-1.5B-01a7051a-d242-4c8b-82a8-7ef77a5838ed-orpo-tuned

Updated May 15

obiwit/llama3.2-3b-orpo-coarse-1e

Text Generation • 3B • Updated Jun 26 • 6

obiwit/llama3.2-3b-orpo-finegrained

Text Generation • 3B • Updated May 18 • 1

BKM1804/Qwen2.5-1.5B-01a7051a-d242-4c8b-82a8-7ef77a5838ed-orpo-before-dpo-tuned-merged

Text Generation • 2B • Updated May 15

silviasapora/mistral-7b-sft-basic-5e-5-000-v140

Updated May 15

silviasapora/mistral-7b-sft-simpo-basic-5e-7-005-v141

Updated May 15

silviasapora/mistral-7b-sft-simpo-basic-5e-7-005-v143

Updated May 15

silviasapora/mistral-7b-sft-simpo-basic-5e-7-005-v144

Updated May 15

silviasapora/mistral-7b-sft-simpo-basic-5e-7-005-v145

Updated May 15

silviasapora/mistral-7b-sft-simpo-basic-5e-7-005-v146

Updated May 15

obiwit/qwen2.5-3b-orpo-finegrained

Text Generation • 3B • Updated May 17 • 1

obiwit/llama3.2-3b-orpo-mini-v2

Text Generation • 3B • Updated May 17 • 1

alicia10/Llama-3.2-1B-unsloth-bnb-4bit-sft-orpo-v11

Text Generation • 0.8B • Updated May 24 • 2

alicia10/Llama-3.2-1B-unsloth-bnb-4bit-sft-orpo-v12

Text Generation • 0.8B • Updated May 25 • 1

alicia10/Qwen2.5-1.5B-unsloth-bnb-4bit-sft-orpo-v13

Text Generation • 0.9B • Updated May 25

Matelq-2/SmolLM2-FT-ORPO

Text Generation • 0.1B • Updated May 29 • 5

thdsofia/orpo_final

Text Generation • 0.6B • Updated May 30

AmberYifan/Llama-3.1-8B-sft-gen-dpo-10k-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Llama-3.1-8B-sft-dpo-10k-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Llama-3.1-8B-sft-SPIN-gpt4o-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Llama-3.1-8B-sft-SPIN-Llama-3.1-70B-Instruct-ORPO

Text Generation • 8B • Updated May 31 • 5 • 1

AmberYifan/Llama-3.1-8B-sft-all-pool-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Llama-3.1-8B-sft-peers-pool-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Llama-3.1-8B-sft-spin-10k-ORPO

Text Generation • 8B • Updated May 31

AmberYifan/Qwen2.5-7B-sft-gen-dpo-10k-ORPO

Text Generation • 8B • Updated Jun 1