Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

preference-optimization

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5

Full-text search

Active filters: preference-optimization

tahamajs/llama-3.2-3b-orpo-lora64-4bit-instruct

Updated 23 days ago • 3

tokutsu/japanese-answer-13b-8bit

Updated 6 days ago • 13

Likhith003/dpo-pairrm-lora-adapter

Text Generation • Updated 8 days ago • 16

Likhith003/dpo-llmjudge-lora-adapter

Text Generation • Updated 8 days ago • 16

jasperyeoh2/mistral-dpo-peft

Updated 2 days ago • 11