Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,4 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# OLM-GPT2-OCT-2022
|
| 2 |
+
|
| 3 |
+
OLM-GPT2-OCT-2022 is a LLM trained with a casual langauge modeling objective on a filtered Common Crawl subset from October.
|
| 4 |
+
The goal of the OLM project is to train LLMs on data that focuses on recency with comparable performence to similar models.
|