view post Post 4925 smolagents now support vLLM! 🥳As one of the most popular local inference solutions, the community had been asking us to integrate vLLM: after a heavy refactoring of our LLM classes, we've just released smolagents 1.11.0, with a brand new VLLMModel class.Go try it and tell us what you think!https://github.com/huggingface/smolagents/blob/45b2c86857b7f7657daaa74e4d17d347e9e2c4a4/src/smolagents/models.py#L497 See translation 🤗 9 9 🔥 5 5 😎 4 4 👍 1 1 🚀 1 1 + Reply