Open Language Data Initiative

openlanguagedata's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

cointegrated 

in openlanguagedata/oldi_seed 3 days ago

Tamasheq data contamination

3

#2 opened about 1 month ago by

ayymen

cointegrated 

in openlanguagedata/flores_plus 4 days ago

(Beginner) Issues using the described method to load FLORES+ dataset

5

#15 opened 5 days ago by

jaecbc

machine

1

#8 opened 2 months ago by

maryamelboraie

Misalignments in the Aranese subset (aran1260)

1

#11 opened about 1 month ago by

OrianeN

Fix misalignments in the Aranese subset (aran1260)

1

#13 opened 18 days ago by

agaliano

cointegrated 

updated a dataset 4 days ago

openlanguagedata/flores_plus

Viewer • Updated 4 days ago • 868k • 3.92k • 29

cointegrated 

in openlanguagedata/flores_plus 4 days ago

Split dataset in subsets per language

1

#5 opened 4 months ago by

thomas-ferraz

laurievb 

authored 3 papers 9 days ago

An Open Dataset and Model for Language Identification

Paper • 2305.13820 • Published May 23, 2023

The University of Edinburgh's Submission to the WMT22 Code-Mixing Shared Task (MixMT)

Paper • 2210.11309 • Published Oct 20, 2022

An Expanded Massive Multilingual Dataset for High-Performance Language Technologies

Paper • 2503.10267 • Published 15 days ago

cointegrated 

in openlanguagedata/flores_plus 22 days ago

[DRAFT] Fix orthography in the Russian dev set

4

#4 opened 4 months ago by

cointegrated

Fix encoding at chv devtest

4

#9 opened about 2 months ago by

alexantonov

laurievb 

updated a dataset about 1 month ago

openlanguagedata/flores_plus

Viewer • Updated 4 days ago • 868k • 3.92k • 29

laurievb 

in openlanguagedata/flores_plus about 1 month ago

lld_valbadia

#10 opened about 2 months ago by

sfrontull

cointegrated 

in openlanguagedata/flores_plus about 2 months ago

Added Dargwa dev set to flores_plus

2

#3 opened 4 months ago by

Murtazali

laurievb 

in openlanguagedata/flores_plus about 2 months ago

Fix encoding at chv devtest

4

#9 opened about 2 months ago by

alexantonov

jeanma 

updated a Space 2 months ago

Running

Submit

🏆

Generate a Parquet file for dataset validation

jeanma 

published a Space 2 months ago

Running

Submit

🏆

Generate a Parquet file for dataset validation

laurievb 

in openlanguagedata/flores_plus 2 months ago

Add data integrity tests

1

#7 opened 3 months ago by

cointegrated

jeanma 

updated a dataset 4 months ago

openlanguagedata/flores_plus

Viewer • Updated 4 days ago • 868k • 3.92k • 29