Baseline Models Models Trained on Redpajama-CC Data-Selection/BSL-160M Text Generation • Updated Oct 28, 2024 • 45 Data-Selection/BSL-470M Text Generation • Updated Oct 28, 2024 • 11 Data-Selection/BSL-1.7B Text Generation • Updated Mar 25 • 12 Data-Selection/BSL-1B Text Generation • Updated Oct 28, 2024 • 12
PDS-Models Models trained on PDS-Selected Data Data-Selection/PDS-160M Text Generation • 0.2B • Updated Mar 25 • 15 Data-Selection/PDS-470M Text Generation • 0.5B • Updated Mar 25 • 13 Data-Selection/PDS-1B Text Generation • Updated Mar 25 • 10 Data-Selection/PDS-1.7B Text Generation • Updated Mar 25 • 14
Baseline Models Models Trained on Redpajama-CC Data-Selection/BSL-160M Text Generation • Updated Oct 28, 2024 • 45 Data-Selection/BSL-470M Text Generation • Updated Oct 28, 2024 • 11 Data-Selection/BSL-1.7B Text Generation • Updated Mar 25 • 12 Data-Selection/BSL-1B Text Generation • Updated Oct 28, 2024 • 12
PDS-Models Models trained on PDS-Selected Data Data-Selection/PDS-160M Text Generation • 0.2B • Updated Mar 25 • 15 Data-Selection/PDS-470M Text Generation • 0.5B • Updated Mar 25 • 13 Data-Selection/PDS-1B Text Generation • Updated Mar 25 • 10 Data-Selection/PDS-1.7B Text Generation • Updated Mar 25 • 14