Apply for community grant: Academic project (gpu)

#1
by vinzur - opened

Prompt-to-PlantUML is an open-source project (part of the AiUML project) that transforms natural language prompts into PlantUML diagrams. It leverages a retrieval-augmented generation pipeline by integrating a custom dataset (now hosted on Hugging Face), a SentenceTransformer-based embedding model with FAISS for rapid similarity search, and a GPTQ quantized text-generation model to create accurate diagram code. The generated PlantUML code is then converted into a URL for seamless visualization in PlantUML server.

I have deployed a Gradio app for it on Spaces, but due to current free CPU plan, response times are significantly delayed. GPU support would dramatically reduce inference time to generate diagrams.

FINAL.png

Sign up or log in to comment