maywell commited on
Commit
9698e26
ยท
1 Parent(s): 10b1598

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -51,6 +51,7 @@ text = "<s>[INST] ์•„์ด์ž‘ ๋‰ดํ„ด์˜ ์—…์ ์„ ์•Œ๋ ค์ค˜. [/INST] "
51
  [EleutherAI/lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness/tree/polyglot)๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ BoolQ, SentiNeg, Wic์„ ์ธก์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.
52
 
53
  HellaSwag์™€ COPA๋Š” ์›๋ณธ์ฝ”๋“œ๋ฅผ ์ˆ˜์ •ํ•˜๋Š” ๊ณผ์ •์—์„œ ์–ด๋ ค์›€์„ ๊ฒช์–ด ์•„์ง ์ง„ํ–‰ํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
 
54
  **NOTE** | BoolQ๋Š” Instruction ๋ชจ๋ธ์˜ ์ดํ•ด๋ฅผ ๋•๊ธฐ์œ„ํ•ด "์œ„ ๊ธ€์— ๋Œ€ํ•œ ์งˆ๋ฌธ์— ์‚ฌ์‹ค์„ ํ™•์ธํ•˜๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค.", "์˜ˆ, ์•„๋‹ˆ์˜ค๋กœ ๋Œ€๋‹ตํ•ด์ฃผ์„ธ์š”."์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์ถ”๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค.
55
  SentiNeg, Wic์˜ ๊ฒฝ์šฐ๋Š” [INST], [\INST]๋งŒ ์ถ”๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
56
 
 
51
  [EleutherAI/lm-evaluation-harness](https://github.com/EleutherAI/lm-evaluation-harness/tree/polyglot)๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ BoolQ, SentiNeg, Wic์„ ์ธก์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.
52
 
53
  HellaSwag์™€ COPA๋Š” ์›๋ณธ์ฝ”๋“œ๋ฅผ ์ˆ˜์ •ํ•˜๋Š” ๊ณผ์ •์—์„œ ์–ด๋ ค์›€์„ ๊ฒช์–ด ์•„์ง ์ง„ํ–‰ํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
54
+
55
  **NOTE** | BoolQ๋Š” Instruction ๋ชจ๋ธ์˜ ์ดํ•ด๋ฅผ ๋•๊ธฐ์œ„ํ•ด "์œ„ ๊ธ€์— ๋Œ€ํ•œ ์งˆ๋ฌธ์— ์‚ฌ์‹ค์„ ํ™•์ธํ•˜๋Š” ์ž‘์—…์ž…๋‹ˆ๋‹ค.", "์˜ˆ, ์•„๋‹ˆ์˜ค๋กœ ๋Œ€๋‹ตํ•ด์ฃผ์„ธ์š”."์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์ถ”๊ฐ€ํ–ˆ์Šต๋‹ˆ๋‹ค.
56
  SentiNeg, Wic์˜ ๊ฒฝ์šฐ๋Š” [INST], [\INST]๋งŒ ์ถ”๊ฐ€ํ•˜์˜€์Šต๋‹ˆ๋‹ค.
57