mindw96 commited on
Commit
638f538
·
verified ·
1 Parent(s): 7b58bb6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - beomi/KoAlpaca-v1.1a
4
+ language:
5
+ - ko
6
+ - en
7
+ base_model:
8
+ - meta-llama/Llama-3.3-70B-Instruct
9
+ library_name: transformers
10
+ ---
11
+ ## Model Details
12
+
13
+ **Llama-3.3-70B-Korean-4Bit-bnb**
14
+
15
+ Llama-3.3-70B-Korean-4Bit-bnb is continued pretrained(4bit quantization fine-tuned) language model based on Llama-3.3-70B-Instruct.
16
+
17
+ This model is trained fully with publicily available resource at HuggingFace dataset hub, preprocessed Korean texts.
18
+
19
+ The train was done on A6000 48GB * 4.
20
+
21
+ **Model developers** Dongwook Min (mindw96)
22
+
23
+ **Dataset** beomi/KoAlpaca-v1.1a
24
+
25
+ **Variations** Llama-3.3-70B-Korean-4Bit-bnb comes in one size — 8B.
26
+
27
+ **Input** Models input text only.
28
+
29
+ **Output** Models generate text only.
30
+
31
+ **Model Release Date** 04.01.2025.