mixtral-chat-live

Runtime error

johann22 commited on Dec 29, 2023

Commit

c2ecdc0

1 Parent(s): 1789646

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -58,7 +58,7 @@ def run_gpt(
     print (seed)
     generate_kwargs = dict(
         temperature=1.0,
-        max_new_tokens=512,
         top_p=0.99,
         repetition_penalty=1.0,
         do_sample=True,

     print (seed)
     generate_kwargs = dict(
         temperature=1.0,
+        max_new_tokens=2048,
         top_p=0.99,
         repetition_penalty=1.0,
         do_sample=True,