Qiying Yu

qiying

AI & ML interests

None yet

Recent Activity

Organizations

Beijing Academy of Artificial Intelligence's profile picture Tsinghua University's profile picture OpenChat's profile picture OpenChat Dev's profile picture BytedTsinghua-SIA's profile picture

qiying's activity

New activity in CausalLM/miniG 7 months ago
upvoted an article 9 months ago
view article
Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

β€’ 82
reacted to merve's post with ❀️ 10 months ago
view post
Post
EVA-CLIP πŸ¦– is the CLIP scaled to the moon! πŸ”₯
The new SotA CLIP-like model πŸ†
Highlights ✨
- Performs better in linear probing
- Outperforms in Zero-Shot Image-Text Retrieval
- Higher zero-shot accuracy in IN-1K

As usual, try it with the notebook I built for you https://colab.research.google.com/drive/1K7DdCORC3x4qyhwhuB4fT4wcfJ_BQLKw?usp=sharing#scrollTo=0ZS_lJ7SK6Ys
I also built a Space for you to compare the output probabilities to CLIP, seems that EVACLIP is more "sure" of it's results 😊 merve/EVACLIP
The authors have shared 8B checkpoints open with Apache 2.0 license πŸ’œ and it's built on top of transformers, super easy to use! BAAI/EVA-CLIP-8B
Read the paper EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters (2402.04252) πŸ“„
New activity in NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO about 1 year ago

Training Hyperparameters

#6 opened about 1 year ago by
qiying