Lambent commited on
Commit
181910c
·
verified ·
1 Parent(s): db61d16

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -1
README.md CHANGED
@@ -12,7 +12,30 @@ Intuitively it seemed like LISA training should suit a MoE pretty well; though I
12
 
13
  Interesting thing about this one is it looks like it wasn't converging at the end of one epoch. Still more to learn.
14
 
15
- Generalization eval pending.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
18
  <details><summary>See axolotl config</summary>
 
12
 
13
  Interesting thing about this one is it looks like it wasn't converging at the end of one epoch. Still more to learn.
14
 
15
+ Nous capabilities:
16
+
17
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
18
+ |-----------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
19
+ |[CosMoEAlpacaLisa-4x1b](https://huggingface.co/Lambent/CosMoEAlpacaLisa-4x1b)| 23.44| 48.13| 41.13| 29.95| 35.66|
20
+
21
+ Comparisons:
22
+
23
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
24
+ |---------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
25
+ |[CosMoE-AlpacaLight-v0.6](https://huggingface.co/Lambent/CosMoE-AlpacaLight-v0.6)| 23.3| 52.15| 38.57| 29.01| 35.76|
26
+
27
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
28
+ |-------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
29
+ |[CosmoAlpacaLisa-0.3-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-0.3-1b)| 23.79| 51.61| 40.25| 29.97| 36.41|
30
+
31
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
32
+ |-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
33
+ |[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)| 24.28| 51.31| 40.33| 29.47| 36.35|
34
+
35
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
36
+ |---------------------------------------------------------|------:|------:|---------:|-------:|------:|
37
+ |[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
38
+
39
 
40
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
41
  <details><summary>See axolotl config</summary>