An Expanded Massive Multilingual Dataset for High-Performance Language Technologies
Paper
•
2503.10267
•
Published
OpenEuroLLM
community
AI & ML interests
Open, Multilingual, European, Generative, Foundational LLM
Recent Activity
View all activity
openeurollm's activity
tiedeman
authored
a
paper
3 days ago
mbanon
authored
a
paper
4 days ago
gramirez-prompsit
updated
a
Space
11 days ago
gramirez-prompsit
published
a
Space
11 days ago
flxst
authored
2
papers
about 1 month ago
mbanon
authored
2
papers
2 months ago
tiedeman
authored
11
papers
5 months ago
Uncertainty-Aware Natural Language Inference with Stochastic Weight Averaging
Paper
•
2304.04726
•
Published
Sentence Embeddings in NLI with Iterative Refinement Encoders
Paper
•
1808.08762
•
Published
Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health
Paper
•
2304.10447
•
Published
•
1
The University of Helsinki submissions to the WMT19 news translation task
Paper
•
1906.04040
•
Published
Predicting Prosodic Prominence from Text with Pre-trained Contextualized Word Representations
Paper
•
1908.02262
•
Published
XED: A Multilingual Dataset for Sentiment Analysis and Emotion Detection
Paper
•
2011.01612
•
Published
•
1
NLI Data Sanity Check: Assessing the Effect of Data Corruption on Model Performance
Paper
•
2104.04751
•
Published
How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets
Paper
•
2201.04467
•
Published
A New Massive Multilingual Dataset for High-Performance Language Technologies
Paper
•
2403.14009
•
Published
•
1
EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models
Paper
•
2409.17892
•
Published
•
2
The Tatoeba Translation Challenge -- Realistic Data Sets for Low Resource and Multilingual MT
Paper
•
2010.06354
•
Published
Post
2322
🌟 Progress in the German FineWeb edu reproduction 🌟
We're delighted to share the launch of our new Data Quality Classification Model, designed specifically for evaluating educational content in German. This tool uses advanced machine learning techniques to assess texts across all educational levels, from primary school to university.
🔍 Inspired by Huggingface's fine web edu dataset, we've worked hard to refine data classification methods ensuring educators and learners access top-quality resources.
We're excited about the future as we continue improving our models and expanding our datasets.
Access the model here: pL-Community/GermanEduScorer-Qwen2-1.5b
🙏 A huge thank you to David and Daryoush from Vago Solutions; Björn and Jan from Ellamind / DiscoResearch for their expert insights throughout this project. Your support has been crucial.
This project was made possible by the support of PrimeLine AI.
We're delighted to share the launch of our new Data Quality Classification Model, designed specifically for evaluating educational content in German. This tool uses advanced machine learning techniques to assess texts across all educational levels, from primary school to university.
🔍 Inspired by Huggingface's fine web edu dataset, we've worked hard to refine data classification methods ensuring educators and learners access top-quality resources.
We're excited about the future as we continue improving our models and expanding our datasets.
Access the model here: pL-Community/GermanEduScorer-Qwen2-1.5b
🙏 A huge thank you to David and Daryoush from Vago Solutions; Björn and Jan from Ellamind / DiscoResearch for their expert insights throughout this project. Your support has been crucial.
This project was made possible by the support of PrimeLine AI.
- 2 replies