chatty123
/

mistral_rank8_dpo

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded model

Developed by: chatty123
License: apache-2.0
Finetuned from model : unsloth/mistral-7b-instruct-v0.2-bnb-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: -

Safetensors

Model size

7B params

Tensor type

BF16

·

Model tree for chatty123/mistral_rank8_dpo

Base model

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Finetuned

(468)

this model