mindw96's picture
Create README.md
638f538 verified
|
raw
history blame
744 Bytes
metadata
datasets:
  - beomi/KoAlpaca-v1.1a
language:
  - ko
  - en
base_model:
  - meta-llama/Llama-3.3-70B-Instruct
library_name: transformers

Model Details

Llama-3.3-70B-Korean-4Bit-bnb

Llama-3.3-70B-Korean-4Bit-bnb is continued pretrained(4bit quantization fine-tuned) language model based on Llama-3.3-70B-Instruct.

This model is trained fully with publicily available resource at HuggingFace dataset hub, preprocessed Korean texts.

The train was done on A6000 48GB * 4.

Model developers Dongwook Min (mindw96)

Dataset beomi/KoAlpaca-v1.1a

Variations Llama-3.3-70B-Korean-4Bit-bnb comes in one size — 8B.

Input Models input text only.

Output Models generate text only.

Model Release Date 04.01.2025.