Cathaltwo commited on
Commit
1a64054
·
verified ·
1 Parent(s): dcc10ca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -2
README.md CHANGED
@@ -5,6 +5,15 @@ tags:
5
  model-index:
6
  - name: gemma3_bilingual_cpt_fast
7
  results: []
 
 
 
 
 
 
 
 
 
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -19,7 +28,8 @@ It achieves the following results on the evaluation set:
19
 
20
  ## Model description
21
 
22
- More information needed
 
23
 
24
  ## Intended uses & limitations
25
 
@@ -62,4 +72,4 @@ The following hyperparameters were used during training:
62
  - Transformers 4.56.1
63
  - Pytorch 2.8.0+cu126
64
  - Datasets 4.0.0
65
- - Tokenizers 0.22.0
 
5
  model-index:
6
  - name: gemma3_bilingual_cpt_fast
7
  results: []
8
+ license: gemma
9
+ datasets:
10
+ - Helsinki-NLP/opus-100
11
+ - ReliableAI/Irish-Text-Collection
12
+ language:
13
+ - en
14
+ - ga
15
+ base_model:
16
+ - google/gemma-3-270m
17
  ---
18
 
19
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
28
 
29
  ## Model description
30
 
31
+ Simple Continued pretraining of gemma-3-270m for Irish (80%) and English (20%) as a test for generating better Irish understanding.
32
+ Heavily influenced by the work done by [reliableai](https://huggingface.co/ReliableAI/UCCIX-Llama2-13B)
33
 
34
  ## Intended uses & limitations
35
 
 
72
  - Transformers 4.56.1
73
  - Pytorch 2.8.0+cu126
74
  - Datasets 4.0.0
75
+ - Tokenizers 0.22.0