Request support for text-only inference in transformers (Mistral3ForCausalLM class)
#32
by
alan925
- opened
Hello, I want to compliment the Mistral team for their work on Mistral 3.1. I realize the model was just released this week, and it takes a lot of work to support all these different inference platforms.
My request is we add support for text-only prompts for Mistral 3.1. Using the latest Github commit (20 March 2025), I do not think no-image prompts work using the Mistral3ForConditionalGeneration class. I'm guessing we need a Mistral3ForCausalLM class.
yeah, need it too
Hi! Why not just do something like this:
model_id = "mistralai/Mistral-Small-3.1-24B-Instruct-2503"
model = Mistral3ForConditionalGeneration.from_pretrained(model_id, device_map="auto")
lm = model.language_model
Then you should be able to process just texts without needing to pass the images