Shubhashis Roy Dipta PRO
dipta007
AI & ML interests
Multimodal Understanding, Reasoning, Generation
Recent Activity
updated
a dataset
30 minutes ago
GanitLLM/tmp_2_tagged_difficulty
updated
a dataset
about 6 hours ago
GanitLLM/rl_train_dev_split_balanced
updated
a dataset
about 7 hours ago
GanitLLM/tmp_combined_difficulty
Organizations
-
Textbooks Are All You Need
Paper • 2306.11644 • Published • 146 -
LLaVA-φ: Efficient Multi-Modal Assistant with Small Language Model
Paper • 2401.02330 • Published • 18 -
Textbooks Are All You Need II: phi-1.5 technical report
Paper • 2309.05463 • Published • 88 -
Visual Instruction Tuning
Paper • 2304.08485 • Published • 19
https://github.com/Zhen-Tan-dmml/LLM4Annotation
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 50 -
Large Language Models for Data Annotation: A Survey
Paper • 2402.13446 • Published • 1 -
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators
Paper • 2303.16854 • Published • 1 -
Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text-Annotation Tasks
Paper • 2307.02179 • Published • 7
-
MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
Paper • 2401.10208 • Published • 1 -
ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
Paper • 2305.11172 • Published • 2 -
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Paper • 2302.00402 • Published -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 9
-
122
Open VLM Video Leaderboard
🌎VLMEvalKit Eval Results in video understanding benchmark
-
13.6k
Open LLM Leaderboard
🏆Track, rank and evaluate open LLMs and chatbots
-
1.08k
Open ASR Leaderboard
🏆View and request speech recognition model benchmarks
-
888
Open VLM Leaderboard
🌎VLMEvalKit Evaluation Results Collection
-
M^3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning
Paper • 2306.04387 • Published • 8 -
Datasets for Large Language Models: A Comprehensive Survey
Paper • 2402.18041 • Published • 2 -
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark
Paper • 2306.06687 • Published • 1 -
Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidents
Paper • 2201.04236 • Published
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 63 -
Self-Rewarding Language Models
Paper • 2401.10020 • Published • 151 -
Training language models to follow instructions with human feedback
Paper • 2203.02155 • Published • 23
-
122
Open VLM Video Leaderboard
🌎VLMEvalKit Eval Results in video understanding benchmark
-
13.6k
Open LLM Leaderboard
🏆Track, rank and evaluate open LLMs and chatbots
-
1.08k
Open ASR Leaderboard
🏆View and request speech recognition model benchmarks
-
888
Open VLM Leaderboard
🌎VLMEvalKit Evaluation Results Collection
-
Textbooks Are All You Need
Paper • 2306.11644 • Published • 146 -
LLaVA-φ: Efficient Multi-Modal Assistant with Small Language Model
Paper • 2401.02330 • Published • 18 -
Textbooks Are All You Need II: phi-1.5 technical report
Paper • 2309.05463 • Published • 88 -
Visual Instruction Tuning
Paper • 2304.08485 • Published • 19
https://github.com/Zhen-Tan-dmml/LLM4Annotation
-
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models
Paper • 2402.13064 • Published • 50 -
Large Language Models for Data Annotation: A Survey
Paper • 2402.13446 • Published • 1 -
AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators
Paper • 2303.16854 • Published • 1 -
Open-Source Large Language Models Outperform Crowd Workers and Approach ChatGPT in Text-Annotation Tasks
Paper • 2307.02179 • Published • 7
-
MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
Paper • 2401.10208 • Published • 1 -
ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
Paper • 2305.11172 • Published • 2 -
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
Paper • 2302.00402 • Published -
Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities
Paper • 2308.12966 • Published • 9
-
M^3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning
Paper • 2306.04387 • Published • 8 -
Datasets for Large Language Models: A Comprehensive Survey
Paper • 2402.18041 • Published • 2 -
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark
Paper • 2306.06687 • Published • 1 -
Incidents1M: a large-scale dataset of images with natural disasters, damage, and incidents
Paper • 2201.04236 • Published
-
Proximal Policy Optimization Algorithms
Paper • 1707.06347 • Published • 11 -
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Paper • 2305.18290 • Published • 63 -
Self-Rewarding Language Models
Paper • 2401.10020 • Published • 151 -
Training language models to follow instructions with human feedback
Paper • 2203.02155 • Published • 23