etri-xainlp/llama2-12.8b_lora-dpo_v1

Model Details

Model Developers ETRI xainlp team

Input text only.

Output text only.

Model Architecture

Base Model meta-llama/Llama-13b-hf

Training Dataset

  • sft+lora: 710k instruction-following set

  • dpo+lora: 90k user preference set

  • We use A100 GPU 80GB * 8, when training.

Downloads last month
2
Safetensors
Model size
13B params
Tensor type
FP16
Β·
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for etri-xainlp/llama2-12.8b_lora-dpo_v1

Quantizations
2 models

Spaces using etri-xainlp/llama2-12.8b_lora-dpo_v1 6