Base Model:

We made a LLM model with yanolja/KoSOLAR-10.7B-v0.3

Model Description

We use QLoRA(64, 16) and NEFTune on LLM Fine-tuning lr=1e-5

Train Detail

Our Korean data used, and 1 epoch train

Others

We are making LLM model for Kolon !

Downloads last month
843
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for KBNIT/KoSOLAR-10.7B-QLoRA-NEFTune-kolon-v2.0

Quantizations
4 models