matsuo-lab
/

weblab-10b-instruction-sft

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

matsuo-lab commited on Aug 17, 2023

Commit

a4ec091

•

1 Parent(s): 1aeb8d7

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -82,7 +82,7 @@ with torch.no_grad():
         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
-        temperature=0.6,
         top_p=0.9,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,

         token_ids.to(model.device),
         max_new_tokens=100,
         do_sample=True,
+        temperature=0.5,
         top_p=0.9,
         pad_token_id=tokenizer.pad_token_id,
         bos_token_id=tokenizer.bos_token_id,