ilsp
/

Llama-Krikri-8B-Instruct

Text Generation

text-generation-inference

Model card Files Files and versions

droussis commited on Feb 8

Commit

4b35d9a

·

verified ·

1 Parent(s): 8a6f1a1

Update vLLM serve with parameters

Files changed (1) hide show

README.md +6 -1

README.md CHANGED Viewed

@@ -101,7 +101,12 @@ messages = [
 ]
 response = client.chat.completions.create(model="ilsp/Llama-Krikri-8B-Instruct",
-                                          messages=messages)
 print(response.choices[0].message.content)
 ```

 ]
 response = client.chat.completions.create(model="ilsp/Llama-Krikri-8B-Instruct",
+                                          messages=messages,
+                                          temperature=0.1,
+                                          top_p=0.95,
+                                          max_tokens=8192,
+                                          stream=False)
 print(response.choices[0].message.content)
 ```