Hugging Face's logo

almanach
/
moderncamembert-base

Fill-Mask
Transformers
PyTorch
TensorBoard
Safetensors
French
modernbert
camembert
Model card Files Metrics Community
1
wissamantoun commited on
Commit
9b7b01d
·
verified ·
1 Parent(s): c0e5a8b

Upload folder using huggingface_hub

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +60 -0
  2. config.json +43 -0
  3. model.safetensors +3 -0
  4. p3_final_ckpt.pt +3 -0
  5. pytorch_model.bin +3 -0
  6. special_tokens_map.json +51 -0
  7. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324161.52 +3 -0
  8. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324162.1 +3 -0
  9. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324163.1 +3 -0
  10. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324164.1 +3 -0
  11. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261196.1 +3 -0
  12. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261197.1 +3 -0
  13. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261198.1 +3 -0
  14. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261199.1 +3 -0
  15. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489679.1 +3 -0
  16. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489680.1 +3 -0
  17. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489681.1 +3 -0
  18. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489682.1 +3 -0
  19. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392708.1 +3 -0
  20. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392709.1 +3 -0
  21. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392710.1 +3 -0
  22. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392711.1 +3 -0
  23. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395305.1 +3 -0
  24. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395306.1 +3 -0
  25. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395307.1 +3 -0
  26. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395308.1 +3 -0
  27. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452508.1 +3 -0
  28. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452509.1 +3 -0
  29. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452510.1 +3 -0
  30. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452511.1 +3 -0
  31. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477488.1 +3 -0
  32. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477489.1 +3 -0
  33. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477490.1 +3 -0
  34. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477491.1 +3 -0
  35. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851524.1 +3 -0
  36. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851525.1 +3 -0
  37. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851526.1 +3 -0
  38. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851527.1 +3 -0
  39. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800980.1 +3 -0
  40. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800981.1 +3 -0
  41. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800982.1 +3 -0
  42. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800983.1 +3 -0
  43. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573816.1 +3 -0
  44. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573817.1 +3 -0
  45. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573818.1 +3 -0
  46. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573819.1 +3 -0
  47. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798233.1 +3 -0
  48. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798234.1 +3 -0
  49. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798235.1 +3 -0
  50. summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798236.1 +3 -0
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language: fr
4
+ library_name: transformers
5
+ pipeline_tag: fill-mask
6
+ datasets:
7
+ - togethercomputer/RedPajama-Data-V2
8
+ - almanach/HALvest
9
+ - wikimedia/wikipedia
10
+ tags:
11
+ - modernbert
12
+ - camembert
13
+ ---
14
+ # ModernCamemBERT
15
+
16
+ [ModernCamemBERT](TODO) is a French language model pretrained on a large corpus of 1T tokens of High-Quality French text. It is the French version of the [ModernBERT](https://huggingface.co/answerdotai/ModernBERT-base) model. ModernCamemBERT was trained using the Masked Language Modeling (MLM) objective with 30% mask rate on 1T tokens on 48 H100 GPUs. The dataset used for training is a combination of French [RedPajama-V2](https://huggingface.co/datasets/togethercomputer/RedPajama-Data-V2) filtered using heuristic and semantic filtering, French scientific documents from [HALvest](https://huggingface.co/datasets/almanach/HALvest), and the French Wikipedia. Semantic filtering was done by fine-tuning a BERT classifier trained on a document quality dataset automatically labeled by LLama-3 70B.
17
+ We also re-use the old [CamemBERTav2](https://huggingface.co/almanach/camembertav2-base) tokenizer. The model was first trained with 1024 context length which was then increased to 8192 tokens later in the pretraining. More details about the training process can be found in the [ModernCamemBERT](TODO) paper.
18
+
19
+ The goal of ModernCamemBERT was to run a controlled study by pretraining ModernBERT on the same dataset as CamemBERTaV2, a DeBERTaV3 French model, isolating the effect of model design. Our results show that the previous model generation remains superior in sample efficiency and overall benchmark performance, with ModernBERT’s primary advantage being faster training and inference speed. However, the new proposed model still provides meaningful architectural improvements compared to earlier models such as the BERT and RoBERTa CamemBERT/v2 model. Additionally, we observe that high-quality pre-training data accelerates convergence but does not significantly improve final performance, suggesting potential benchmark saturation.
20
+
21
+ **We recommend using the ModernCamemBERT model for tasks that require a large context length or efficient inference speed.** Other tasks should still use the CamemBERTaV2 model, which is still the best performing model on most benchmarks.
22
+
23
+ We release two versions of the model: [`almanach/moderncamembert-base`](https://huggingface.co/almanach/moderncamembert-base) and [`almanach/moderncamembert-cv2-base`](https://huggingface.co/almanach/moderncamembert-cv2-base). The first version is the one trained on the new high-quality 1T token dataset, while the second one is the one trained on the old CamemBERTaV2 dataset. The two models are trained with the same architecture and hyperparameters.
24
+
25
+
26
+ ## How to use
27
+ ```python
28
+ from transformers import AutoTokenizer, AutoModel, AutoModelForMaskedLM
29
+
30
+ model = AutoModel.from_pretrained("almanach/moderncamembert-base")
31
+ tokenizer = AutoTokenizer.from_pretrained("almanach/moderncamembert-base")
32
+ ```
33
+
34
+ ## Fine-tuning Results:
35
+
36
+ Datasets: NER (FTB), the FLUE benchmark (XNLI, CLS, PAWS-X), the French Question Answering Dataset (FQuAD).
37
+
38
+
39
+ | Model | FTB-NER | CLS | PAWS-X | XNLI | F1 (FQuAD) | EM (FQuAD) |
40
+ |---------------------|-----------|-----------|-----------|-----------|------------|------------|
41
+ | CamemBERT | 89.97 | 94.62 | 91.36 | 81.95 | 80.98 | 62.51 |
42
+ | CamemBERTa | 90.33 | 94.92 | 91.67 | 82.00 | 81.15 | 62.01 |
43
+ | CamemBERTv2 | 81.99 | 95.07 | 92.00 | 81.75 | 80.98 | 61.35 |
44
+ | **CamemBERTav2** | **93.40** | **95.63** | **93.06** | **84.82** | **83.04** | **64.29** |
45
+ | ModernCamemBERT-CV2 | 92.17 | 94.86 | 92.71 | 82.85 | 81.68 | 62.00 |
46
+ | ModernCamemBERT | 91.33 | 94.92 | 92.52 | 83.62 | 82.19 | 62.66 |
47
+
48
+ Finetuned models are available in the following collection: [ModernCamembert Models](https://huggingface.co/collections/almanach/moderncamembert-67f7e6d85ede5f7cfc1ce012)
49
+
50
+ ## Pretraining Codebase
51
+
52
+ We use the pretraining codebase from the [ModernBERT repository](https://github.com/AnswerDotAI/ModernBERT) for all ModernCamemBERT models.
53
+
54
+
55
+ ## Citation
56
+
57
+ ```bibtex
58
+ @misc{TODO
59
+ }
60
+ ```
config.json ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "ModernBertForMaskedLM"
4
+ ],
5
+ "attention_bias": false,
6
+ "attention_dropout": 0.0,
7
+ "bos_token_id": 1,
8
+ "classifier_activation": "silu",
9
+ "classifier_bias": false,
10
+ "classifier_dropout": 0.0,
11
+ "classifier_pooling": "mean",
12
+ "cls_token_id": 1,
13
+ "decoder_bias": true,
14
+ "deterministic_flash_attn": false,
15
+ "embedding_dropout": 0.0,
16
+ "eos_token_id": 2,
17
+ "global_attn_every_n_layers": 3,
18
+ "global_rope_theta": 160000.0,
19
+ "gradient_checkpointing": false,
20
+ "hidden_activation": "gelu",
21
+ "hidden_size": 768,
22
+ "initializer_cutoff_factor": 2.0,
23
+ "initializer_range": 0.02,
24
+ "intermediate_size": 1152,
25
+ "layer_norm_eps": 1e-05,
26
+ "local_attention": 128,
27
+ "local_rope_theta": 10000.0,
28
+ "max_position_embeddings": 8192,
29
+ "mlp_bias": false,
30
+ "mlp_dropout": 0.0,
31
+ "model_type": "modernbert",
32
+ "norm_bias": false,
33
+ "norm_eps": 1e-05,
34
+ "num_attention_heads": 12,
35
+ "num_hidden_layers": 22,
36
+ "pad_token_id": 0,
37
+ "position_embedding_type": "absolute",
38
+ "sep_token_id": 2,
39
+ "tie_word_embeddings": true,
40
+ "torch_dtype": "float32",
41
+ "transformers_version": "4.48.0",
42
+ "vocab_size": 32768
43
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b260a42b474c4677972706c091c9fa3fcd253b9c66f3243c846dee3b2fec3e3a
3
+ size 544497400
p3_final_ckpt.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1087da0ab23e6b00011da0e0f00a35a4bf3e65e09868b6b2a84d8633194df103
3
+ size 1736151272
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adc2acc4f88a96513012d843a147be008ab6aff1559d1a67a139c17b720b0dd4
3
+ size 544529454
special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "[CLS]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "[SEP]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "[MASK]",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "[PAD]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "[SEP]",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "[UNK]",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324161.52 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d8a2d622d2eb09bc980f74c10196c4d184d1f7cfbc1d58c1824e2b7553d6d6d
3
+ size 1051
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324162.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e986a1eeff4583bac20c55edcc2239643033106a0943202efe2b5adec51a930a
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324163.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f5aaec1ec2ff50a36c1b5855e37a762093dd6fcdbc1245897577bf6fb5c9edf
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh001.3324164.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04fc592c94bc17375f5fdf03616bb7a825fc66572f23065c5f26f97cf148935f
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261196.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c80a94778eff98d051fb905cba262fe02d7750dc5eed0271740197729644ad88
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261197.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69fa5e81c0cdc69910485e3aa5cd4c484685a81ff03e7f15cf6e4fac1aa183b1
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261198.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55ece9813719965a85958fc0c0cee799905c747287526907c9dedf42548bc582
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh002.1261199.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3e5636e48c3fa1c7fd10c781453355cd5b2bb6a4b29dbc86f3fa05b6e185efa
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489679.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3edd653f216389758c4cf7583694a221b66eb765fe04860d6ebd04c191c7d04
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489680.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04c5b8400c5231c3e09e6de49a93a4c1b69ff7cb60216ddfd8e2efd31e0185d8
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489681.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a900314b4e6ed8326eaa2275514d42824fb4074e56c3b340f9f74fd57891eea5
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh003.1489682.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89b75f51ee32afc77fd9160cd6a70c4eb3cf4ba57e7bd950b2e5ca57973b4f0c
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392708.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a3e7c0cbbfc0a44c65273338ef4e855193fec0d040f2326e634bc211e4c50de
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392709.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:217df5c8f6ee2ff7d5971c34960c91d438b1fa2bf17d47f6c81bedfd9e95c1cc
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392710.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b900506224134078aad5dc6058deacf9d5eefda66e36a387d928e35f6819b61c
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh004.1392711.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:037712c650ac3ec6fd7c6f1a1c883cd9466d04241f077f51d2cb59456803d002
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395305.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a12894b9d94cec695b5278bbac3478c1fd0ffbf4440ab5a4823e593423e662ed
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395306.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bca23a25dd75ba6e452d41c5b7d216383c0003f42f933f6abc7c0b796bb1b72
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395307.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0dd5c620f0bfaae14c63512f12690a5cb26dfa10895ab8c911851a6a28edb04c
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh005.1395308.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ab5e977b9f1c0e1cfc8887cd9ae0847e96a1103913f544ec477f2333ddf41b5
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452508.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f0c6199306fb32512af31618d58c88cc61784afa7b6036b450a252a39a42b74
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452509.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f4e3425a46124073b0a9913048c44630456843e8785203be6dbd35b81bec8a6
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452510.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0234a26466df9f22b9a422e610e14f801564562aa2b92661d30b19e0dd25e788
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh006.1452511.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27c2b2f5f876b026ea695901a40425292d365b73980c013323976a65429b3164
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477488.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f048fb8a2c9808a4f793f301c61da6b7daa5a6d5dde17274a6b0ce8ef0a5d98
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477489.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e34e63bb3b1de2757b8f216d393d8f775713b2c8ee82acab89d9af59f22bd0cb
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477490.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:272524eee8190ab793f757c5c06eb968b60732c8d80850855f9c590bed7d6b72
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh007.3477491.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b28f898fc2e28f9ecf9f53db79714d8f9ac67f175e12c9fb16d95ce21e9217f
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851524.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a76d6cffe9785228ba656d5e68a7db12dd3c0dc24860dcfd7785ac15b0b72fe
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851525.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61ca75f11643c10674eb31895b98518c0623bca46d7133da13b6eace146011e6
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851526.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61086cabfdb5da87386a15a1281be0da85dffba5aa90272bf7ef5645f0ef280b
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh008.851527.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74aed254e41d431202697ff3166256df70a3001a763bae79afe53ff65ed1aa94
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800980.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bb083307b69cf3411df878092cb11a1cc3cf608f20b5f279e7dabb3410b4c07
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800981.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecefde827f16d068f7903720e759342c267256932a86a6638320b2e9fe4d4c8f
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800982.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83f52c7d92409fca502676e9f1649a34e0d9c3a0ae674557b2ab8f50e530bb0b
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh009.800983.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72455374ed7e38cb5b302c16178f5d773b01a2c3726ac8f1a077403f3aab626a
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573816.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38d0466d1bf3d0924c4c83a032e66f5d1cc241db36826b2366c6c5506df6d7f7
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573817.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79e5d6879a3316fbcf2637fbd9a4718e1845a1157c634f74a3871a5d2542effb
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573818.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b76610b0b1a509aae4258b2beb18fd2dad6d31e34abec75403e728cea99ea129
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh010.2573819.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9eac537728319f01757bf4247e2068672e1f8ec1a7630b82a7b2f5289904a01c
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798233.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16aca0bb0203a50f6f2bfb05bd5daabddb69586cf817136b529fe941443509a0
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798234.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac797727b4ccf8e7a7979046e8aaac96d53cf12bcd22b5a7780976b801934d92
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798235.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a9250bb9ceb3dbfe765205815d4b77e9a33e2a8b268f9cbee4d1323847075e7
3
+ size 308
summaries/camembertv3-base-p2/camembertv3-base-p2/events.out.tfevents.1740715213.jzxh011.798236.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c55a39e952fbd74593115b3867dbfd8934b19ac3c643f591bf73f871abe8c051
3
+ size 308