Hugging Face's logo

PriyanshiD
/
Llama-3.2-3B-bnb-4bit-python-DPO

Question Answering
Transformers
Safetensors
English
unsloth
llama
trl
Inference Endpoints
Model card Files Community

Uploaded model

  • Developed by: PriyanshiD
  • License: apache-2.0
  • Finetuned from model : unsloth/Llama-3.2-3B-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Question Answering
This model is not currently available via any of the supported Inference Providers.

Model tree for PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO

Base model

meta-llama/Llama-3.2-3B
Quantized
unsloth/Llama-3.2-3B-bnb-4bit
Finetuned
(139)
this model

Dataset used to train PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO