--- license: apache-2.0 title: Sign Language Conversion App sdk: gradio colorFrom: red colorTo: red --- # Sign Language Conversion App This application converts text to sign language videos and can also extract text from images to convert to sign language. ## Features - **Text to Sign Language**: Enter text and get corresponding sign language videos - **Image to Sign Language**: Upload an image with text and get the sign language translation - **AI-powered**: Uses several AI models to improve sign language translations ## How to Use 1. **Text Conversion**: - Go to the "Text to Sign" tab - Enter text in the textbox - Click "Convert Text to Sign" - View the resulting sign language video 2. **Image Conversion**: - Go to the "Image to Text/Caption and Sign" tab - Upload an image with text - Click "Process Image and Convert to Sign" - See the extracted text and corresponding sign language video ## Technical Details The app uses: - SentenceTransformer for text embedding - FAISS for efficient similarity search - OpenAI API through OpenRouter for text processing and image analysis - FFmpeg for video processing - Gradio for the user interface ## Dataset The application relies on a sign language dataset with video clips showing different signs.