A newer version of the Gradio SDK is available:
5.29.0
metadata
license: apache-2.0
title: Sign Language Conversion App
sdk: gradio
colorFrom: red
colorTo: red
Sign Language Conversion App
This application converts text to sign language videos and can also extract text from images to convert to sign language.
Features
- Text to Sign Language: Enter text and get corresponding sign language videos
- Image to Sign Language: Upload an image with text and get the sign language translation
- AI-powered: Uses several AI models to improve sign language translations
How to Use
Text Conversion:
- Go to the "Text to Sign" tab
- Enter text in the textbox
- Click "Convert Text to Sign"
- View the resulting sign language video
Image Conversion:
- Go to the "Image to Text/Caption and Sign" tab
- Upload an image with text
- Click "Process Image and Convert to Sign"
- See the extracted text and corresponding sign language video
Technical Details
The app uses:
- SentenceTransformer for text embedding
- FAISS for efficient similarity search
- OpenAI API through OpenRouter for text processing and image analysis
- FFmpeg for video processing
- Gradio for the user interface
Dataset
The application relies on a sign language dataset with video clips showing different signs.