Article
Releasing the largest multilingual open pretraining dataset
By
•
•
88Zengzhi Wang
SinclairWang
AI & ML interests
Data Engineering for Generative AI
Organizations
SinclairWang's activity
upvoted
an
article
3 days ago
upvoted
3
papers
6 days ago
Self-Consistency Preference Optimization
Paper
•
2411.04109
•
Published
•
13
Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
Paper
•
2411.04996
•
Published
•
47
Balancing Pipeline Parallelism with Vocabulary Parallelism
Paper
•
2411.05288
•
Published
•
18
upvoted
a
paper
7 days ago
upvoted
a
collection
8 days ago
upvoted
a
paper
13 days ago
upvoted
2
papers
24 days ago
upvoted
a
paper
about 1 month ago
upvoted
an
article
about 1 month ago
Article
Scaling AI-based Data Processing with Hugging Face + Dask
•
23
upvoted
4
papers
about 1 month ago
TLDR: Token-Level Detective Reward Model for Large Vision Language Models
Paper
•
2410.04734
•
Published
•
16
LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning
Paper
•
2410.02884
•
Published
•
50
Revisit Large-Scale Image-Caption Data in Pre-training Multimodal Foundation Models
Paper
•
2410.02740
•
Published
•
52
VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment
Paper
•
2410.01679
•
Published
•
22
upvoted
3
papers
about 2 months ago
A Survey on the Honesty of Large Language Models
Paper
•
2409.18786
•
Published
•
30
Atlas-Chat: Adapting Large Language Models for Low-Resource Moroccan Arabic Dialect
Paper
•
2409.17912
•
Published
•
20
TPI-LLM: Serving 70B-scale LLMs Efficiently on Low-resource Edge Devices
Paper
•
2410.00531
•
Published
•
29
upvoted
a
collection
about 2 months ago
upvoted
an
article
about 2 months ago
Article
RegMix: Data Mixture as Regression for Language Model Pre-training
By
•
•
10