abideen/Heimer-dpo-TinyLlama-1.1B
Text Generation
•
Updated
•
5
🤖 TinyLlama Alignment
TinyLlama-1.1B model aligned on Intel's Orca dataset. Comparison of DPO/IPO/KTO.
TinyLlama-1.1B model aligned on Intel's Orca dataset. Comparison of DPO/IPO/KTO.