Image encoding decoding slow (300s / req)
#4
by
jeremyarancio
- opened
I tried the model via llama.cpp. While it gives nice results for text-only, image encoding and decoding takes a lot of time per request (300s)
Any idea how to accelerate text + Image instructions?