Blackroot commited on
Commit
c6db579
·
verified ·
1 Parent(s): 6c3f0d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -5,6 +5,11 @@ license: mit
5
 
6
  A semi custom network based on the follow paper [Simpler Diffusion (SiD2)](https://arxiv.org/abs/2410.19324v1)
7
 
 
 
 
 
 
8
  ![samples](./1.png)
9
  ![samples](./2.png)
10
  ![samples](./3.png)
 
5
 
6
  A semi custom network based on the follow paper [Simpler Diffusion (SiD2)](https://arxiv.org/abs/2410.19324v1)
7
 
8
+ This network uses the optimal transport flow matching objective outlined [Flow Matching for Generative Modeling](https://arxiv.org/abs/2210.02747)
9
+
10
+ xATGLU Layers are used instead of linears for entry into the transformer MLP layer [Expanded Gating Ranges
11
+ Improve Activation Functions](https://arxiv.org/pdf/2405.20768)
12
+
13
  ![samples](./1.png)
14
  ![samples](./2.png)
15
  ![samples](./3.png)