Fix save compat with HF Transformers 4.39.0

#3
by Qubitium - opened

Latest transformers (4.49.0), likely earlier versions too, will now validate the generation config file and since top_k and temperature non-default values are set, do_sample must be set to True or eles this configuration is self-conflicting.

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment