Lambent commited on
Commit
db61d16
·
verified ·
1 Parent(s): 403b4e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -8,8 +8,11 @@ model-index:
8
  results: []
9
  ---
10
 
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
 
 
 
13
 
14
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
15
  <details><summary>See axolotl config</summary>
 
8
  results: []
9
  ---
10
 
11
+ Intuitively it seemed like LISA training should suit a MoE pretty well; though I don't know how well calibrated my intuitions are.
12
+
13
+ Interesting thing about this one is it looks like it wasn't converging at the end of one epoch. Still more to learn.
14
+
15
+ Generalization eval pending.
16
 
17
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
18
  <details><summary>See axolotl config</summary>