Loading from local storage gives error

#24
by b1rd13 - opened

AttributeError: 'TextGenerationPipeline' object has no attribute 'prefix'.

Using this code to load the model:

model = AutoModel.from_pretrained(model_path)
pipeline = transformers.pipeline("text-generation",
model=model, #"microsoft/phi-4",
tokenizer=tokenizer,
model_kwargs={"torch_dtype": "auto"},
device = 0)

gugarosa changed discussion status to closed
gugarosa changed discussion status to open

Hello @b1rd13 !

Please reach out to the transformers team on GitHub. This repository only accounts for model weights and configuration, i.e., the source code comes directly from transformers.

gugarosa changed discussion status to closed

Sign up or log in to comment