Update README.md
Browse files
README.md
CHANGED
@@ -42,6 +42,52 @@ There are a couple places you can use an exl2 model, here are a few:
|
|
42 |
- With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
|
43 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
44 |
|
45 |
-
|
46 |
|
47 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
- With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
|
43 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
44 |
|
45 |
+
# How to download:
|
46 |
|
47 |
+
### oobabooga's downloader
|
48 |
+
|
49 |
+
use something like [download-model.py](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) to download with python requests.\
|
50 |
+
Install requirements:
|
51 |
+
|
52 |
+
```shell
|
53 |
+
pip install requests tqdm
|
54 |
+
```
|
55 |
+
|
56 |
+
Example for downloading 3bpw:
|
57 |
+
|
58 |
+
```shell
|
59 |
+
python download-model.py Anthonyg5005/ReMM-v2.2-L2-13B-exl2:3bit
|
60 |
+
```
|
61 |
+
|
62 |
+
### huggingface-cli
|
63 |
+
|
64 |
+
You may also use huggingface-cli\
|
65 |
+
To install it, install python hf-hub
|
66 |
+
|
67 |
+
```shell
|
68 |
+
pip install huggingface-hub
|
69 |
+
```
|
70 |
+
|
71 |
+
Example for 3bpw:
|
72 |
+
|
73 |
+
```shell
|
74 |
+
huggingface-cli download Anthonyg5005/ReMM-v2.2-L2-13B-exl2 --local-dir ReMM-v2.2-L2-13B-exl2-3bpw --revision 3bit
|
75 |
+
```
|
76 |
+
### Git LFS (not recommended)
|
77 |
+
|
78 |
+
I would recommend the http downloaders over using git, they can resume downloads if failed and are much easier to work with.\
|
79 |
+
Make sure to have git and git LFS installed.\
|
80 |
+
Example for 3bpw download with git:
|
81 |
+
|
82 |
+
Have LFS file skip disabled
|
83 |
+
```shell
|
84 |
+
# windows
|
85 |
+
set GIT_LFS_SKIP_SMUDGE=0
|
86 |
+
# linux
|
87 |
+
GIT_LFS_SKIP_SMUDGE=0
|
88 |
+
```
|
89 |
+
|
90 |
+
Clone repo branch
|
91 |
+
```shell
|
92 |
+
git clone https://huggingface.co/Anthonyg5005/ReMM-v2.2-L2-13B-exl2 -b 3bit
|
93 |
+
```
|