maywell commited on
Commit
8e3c3e4
ยท
1 Parent(s): 9698e26

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -52,8 +52,11 @@ text = "<s>[INST] ์•„์ด์ž‘ ๋‰ดํ„ด์˜ ์—…์ ์„ ์•Œ๋ ค์ค˜. [/INST] "
52
 
53
  HellaSwag์™€ COPA๋Š” ์›๋ณธ์ฝ”๋“œ๋ฅผ ์ˆ˜์ •ํ•˜๋Š” ๊ณผ์ •์—์„œ ์–ด๋ ค์›€์„ ๊ฒช์–ด ์•„์ง ์ง„ํ–‰ํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
54
 
55
- **NOTE** | BoolQ๋Š” Instruction ๋ชจ๋ธ์˜ ์ดํ•ด๋ฅผ ๋•๊ธฐ์œ„ํ•ด "์œ„ ๊ธ€์— ๋Œ€ํ•œ ์งˆ๋ฌธ์— ์‚ฌ์‹ค์„ ํ™•์ธํ•˜๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค.", "์˜ˆ, ์•„๋‹ˆ์˜ค๋กœ ๋Œ€๋‹ตํ•ด์ฃผ์„ธ์š”."์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์ถ”๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค.
56
- SentiNeg, Wic์˜ ๊ฒฝ์šฐ๋Š” [INST], [\INST]๋งŒ ์ถ”๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
 
 
 
57
 
58
  | Model | COPA | HellaSwag | BoolQ | SentiNeg | Wic
59
  | --- | --- | --- | --- | --- | ---
 
52
 
53
  HellaSwag์™€ COPA๋Š” ์›๋ณธ์ฝ”๋“œ๋ฅผ ์ˆ˜์ •ํ•˜๋Š” ๊ณผ์ •์—์„œ ์–ด๋ ค์›€์„ ๊ฒช์–ด ์•„์ง ์ง„ํ–‰ํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
54
 
55
+ ### **NOTE**
56
+ BoolQ์—๋Š” Instruction ๋ชจ๋ธ์˜ ์ดํ•ด๋ฅผ ๋•๊ธฐ์œ„ํ•ด "์œ„ ๊ธ€์— ๋Œ€ํ•œ ์งˆ๋ฌธ์— ์‚ฌ์‹ค์„ ํ™•์ธํ•˜๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค.", "์˜ˆ, ์•„๋‹ˆ์˜ค๋กœ ๋Œ€๋‹ตํ•ด์ฃผ์„ธ์š”."์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์ถ”๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค.
57
+ SentiNeg์—๋Š” Instruction ๋ชจ๋ธ์˜ ์ดํ•ด๋ฅผ ๋•๊ธฐ์œ„ํ•ด "์œ„ ๋ฌธ์žฅ์˜ ๊ธ์ •, ๋ถ€์ • ์—ฌ๋ถ€๋ฅผ ํŒ๋‹จํ•˜์„ธ์š”."์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์ถ”๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค.
58
+ Wic์˜ ๊ฒฝ์šฐ๋Š” [INST], [\INST]๋งŒ ์ถ”๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
59
+
60
 
61
  | Model | COPA | HellaSwag | BoolQ | SentiNeg | Wic
62
  | --- | --- | --- | --- | --- | ---