Generation parameters

#15

by MRU4913 - opened May 16

Discussion

MRU4913

May 16

•

edited 18 days ago

@alexrs any recommended generation parameters? temperature, top_p, top_k

MRU4913 changed discussion status to closed May 16

MRU4913 changed discussion status to open May 16

alexrs

Cohere Labs org 15 days ago

@MRU4913 depends on your use case! For instance, for temperature: High values (>0.8) are good for creative tasks, low values (e.g. <0.4) for tasks that require “thinking”. Requires do_sample=True.

Experiment with different values and see which ones return the best results for you!

https://huggingface.co/docs/transformers/en/llm_tutorial

alexrs changed discussion status to closed 15 days ago

MRU4913

15 days ago

•

edited 15 days ago

I mean for deployment recommendation @alexrs

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment