AI & ML interests
Audio, Music, and AI
Recent Activity
View all activity
Organization Card
Audio, Music, and AI Lab (AMAAI)
The Audio, Music, and AI lab at Singapore University of Technology and Design focuses on cutting-edge innovations in multimodal AI, more specifically: Audio and Music AI.
More info and publications here.
Popular software:
- SonicVerse: time-aware music captioning: code - live demo
- Music2Emo: emotion detection from music: code - live demo
- Mustango: text-to-music generation: code - live demo
- Video2Music: video-to-music generation: code
- Text2midi: text-to-midi generation: code
- nnAudio: on-the-fly spectrogram extraction: code
Popular Datasets:
- JamendoMaxCaps: text captions with instrumental music audio
- MusicBench: text captions with music audio
- MidiCaps: text captions with music midi (large-scale)
spaces
4
Running
on
Zero
12
SonicVerse
🖼
Generate detailed music descriptions from audio clips
Running
on
Zero
12
Music2emo
📊
Towards Unified Music Emotion Recognition across Dimensional
Runtime error
21
Video2music
📚
Generate music for a video based on its content and key
Running
on
Zero
17
Text2midi
📉
Generate music from text prompts
models
7
amaai-lab/SonicVerse
Audio-Text-to-Text
•
Updated
•
77
•
12
amaai-lab/MelodySim
Updated
•
1
amaai-lab/music2emo
Updated
•
8
amaai-lab/text2midi
Updated
•
13
amaai-lab/DisfluencySpeech_BenchmarkC
Text-to-Speech
•
Updated
•
5
amaai-lab/DisfluencySpeech_BenchmarkB
Text-to-Speech
•
Updated
•
5
amaai-lab/DisfluencySpeech_BenchmarkA
Text-to-Speech
•
Updated
•
6