Spaces:
Running
on
L4
Running
on
L4
Update app.py
Browse files
app.py
CHANGED
@@ -866,7 +866,7 @@ Consider the conversation context to provide a helpful response that acknowledge
|
|
866 |
do_sample=True,
|
867 |
eos_token_id=tokenizer.eos_token_id,
|
868 |
pad_token_id=tokenizer.eos_token_id,
|
869 |
-
repetition_penalty=1.1
|
870 |
attention_mask=None, # β
Let model handle this
|
871 |
use_cache=True # β
Add this for efficiency
|
872 |
|
|
|
866 |
do_sample=True,
|
867 |
eos_token_id=tokenizer.eos_token_id,
|
868 |
pad_token_id=tokenizer.eos_token_id,
|
869 |
+
repetition_penalty=1.1,
|
870 |
attention_mask=None, # β
Let model handle this
|
871 |
use_cache=True # β
Add this for efficiency
|
872 |
|