Base Model:

We made a LLM model with davidkim205/nox-solar-10.7b-v4

Model Description

We use QLOR(256, 64) and NEFTune on LLM Fine-tuning
lr = 1e-5 ,

Train Detail

Our private data used, 5 epoch train, and parameter changed

Others

We are making LLM model for Kolon !

Downloads last month
658
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for gwonny/nox-solar-10.7b-v4-kolon-all-5-v3.0

Quantizations
3 models