how to load model-000x-of-0010.safetensors files from a given path instead of from_hf_hub ?

#17
by xuhao79 - opened

just curious how to load a pre downloaded .safetensors files ?

it seems from_model() will do, but it is not recommended. It is recommended to use from_model instead, but i don't have tokenizer folder under my download. I don't want to put download files in cache.

Mistral AI_ org

Hi, from_hf_hub is only for loading the tokenizer. The safetensors file are automatically downloaded when instantiating the model architecture.

Sign up or log in to comment