moorebrett0 commited on
Commit
27b4078
·
verified ·
1 Parent(s): 4ea6cf9

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +32 -0
README.md CHANGED
@@ -1,3 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Microformer
2
 
3
  **Microformer** is a minimal, educational-scale transformer language model built from scratch in PyTorch.
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ library_name: pytorch
5
+ tags:
6
+ - transformer
7
+ - adapters
8
+ - continual-learning
9
+ - dual-memory
10
+ - minimal
11
+ - educational
12
+ - nlp
13
+ - language-model
14
+ - online-learning
15
+ datasets:
16
+ - text8
17
+ - tinyshakespeare
18
+ model_name: "Microformer"
19
+ model_type: "stacked-adapter-transformer"
20
+ pipeline_tag: text-generation
21
+ widget:
22
+ - text: "Describe the internet"
23
+ - text: "Who is Buck?"
24
+ - text: "Call me Ishmael."
25
+ ---
26
+
27
+
28
+
29
+
30
+
31
+
32
+
33
  # Microformer
34
 
35
  **Microformer** is a minimal, educational-scale transformer language model built from scratch in PyTorch.