Xiang-cd
commited on
Commit
·
51f414c
1
Parent(s):
53823bb
add want2v1.3B tuned module
Browse files- README.md +9 -0
- want2v-1.3B/want2v-1.3B_0.02.pt +3 -0
- want2v-1.3B/want2v-1.3B_0.03.pt +3 -0
- want2v-1.3B/want2v-1.3B_0.04.pt +3 -0
- want2v-1.3B/want2v-1.3B_0.06.pt +3 -0
- want2v-1.3B/want2v-1.3B_0.08.pt +3 -0
README.md
CHANGED
@@ -5,9 +5,18 @@ license: mit
|
|
5 |
# Sparge-attention model zoo
|
6 |
Welcome to Sparge-attention model zoo, this repo contains list of hyperparameters pre-tuned for branch of models.
|
7 |
|
|
|
|
|
|
|
|
|
8 |
|
9 |
## Overview
|
10 |
|
|
|
|
|
|
|
|
|
|
|
11 |
|
12 |
|
13 |
|
|
|
5 |
# Sparge-attention model zoo
|
6 |
Welcome to Sparge-attention model zoo, this repo contains list of hyperparameters pre-tuned for branch of models.
|
7 |
|
8 |
+
## Naming of ckpt
|
9 |
+
The tuned ckpt is often named by following format:`${moddel name or type}_${l1}_${pv_l1}.pt`, in some cases the pv_l1 will be omitted when not choose to tune pv.
|
10 |
+
The larger l1 and pv_l1 make model more sparse, but may sacrifice output quality.
|
11 |
+
|
12 |
|
13 |
## Overview
|
14 |
|
15 |
+
| model name | tuned ckpt dir |
|
16 |
+
| ---- | ---- |
|
17 |
+
| CogVideoX-2b | cogvideox-2b |
|
18 |
+
| want2v-1.3b | want2v-1.3B |
|
19 |
+
|
20 |
|
21 |
|
22 |
|
want2v-1.3B/want2v-1.3B_0.02.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c6163aec4a2ed33fec7ed2c4bf058b05120634cc68f729f8dcd194fe173e769d
|
3 |
+
size 52556
|
want2v-1.3B/want2v-1.3B_0.03.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f38ab400e19f7968d77c6eeea19ecc717c89a781174356a270e831f4824a1835
|
3 |
+
size 52556
|
want2v-1.3B/want2v-1.3B_0.04.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:74bfa8e747353a3b6fc3c5aa7084e96796359e7e9a2a51a5d5ed6059f653660c
|
3 |
+
size 52556
|
want2v-1.3B/want2v-1.3B_0.06.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b51a62f1768b459f020e2af78cca56a32348b5fc4f4e0b85c6a3cf12fd51bdba
|
3 |
+
size 52556
|
want2v-1.3B/want2v-1.3B_0.08.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:575bbd3cb8efdd9323bbce621b03400337d22afae1d2a4278ae88a1343d5b235
|
3 |
+
size 52556
|