other models

#1
by scotto2 - opened

amazing work, it's possible to add support for the 4B and 8B to be used with cross encoder?

Is it possible to load VLLM and serve the /rerank endpoint?

Sign up or log in to comment