Upload modeling_patram.py

#5
by Prince-1 - opened

Added torch_dtype detail.

I am actually trying to train the model using UnSloth.
Was getting error due to this missing of the following value

torch_dtype: Optional[Union[str, torch.dtype]] = "auto" wont this be a better addition as we are using the default of the gpu
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment