Anthonyg5005 commited on
Commit
45f79b3
·
verified ·
1 Parent(s): da119a6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +48 -2
README.md CHANGED
@@ -42,6 +42,52 @@ There are a couple places you can use an exl2 model, here are a few:
42
  - With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
43
  - [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
44
 
45
- ## WARNING
46
 
47
- Model cannot be used commercially due to the Alpaca dataset license. Only use this model for research purposes or personal use.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
  - With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
43
  - [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
44
 
45
+ # How to download:
46
 
47
+ ### oobabooga's downloader
48
+
49
+ use something like [download-model.py](https://github.com/oobabooga/text-generation-webui/blob/main/download-model.py) to download with python requests.\
50
+ Install requirements:
51
+
52
+ ```shell
53
+ pip install requests tqdm
54
+ ```
55
+
56
+ Example for downloading 3bpw:
57
+
58
+ ```shell
59
+ python download-model.py Anthonyg5005/ReMM-v2.2-L2-13B-exl2:3bit
60
+ ```
61
+
62
+ ### huggingface-cli
63
+
64
+ You may also use huggingface-cli\
65
+ To install it, install python hf-hub
66
+
67
+ ```shell
68
+ pip install huggingface-hub
69
+ ```
70
+
71
+ Example for 3bpw:
72
+
73
+ ```shell
74
+ huggingface-cli download Anthonyg5005/ReMM-v2.2-L2-13B-exl2 --local-dir ReMM-v2.2-L2-13B-exl2-3bpw --revision 3bit
75
+ ```
76
+ ### Git LFS (not recommended)
77
+
78
+ I would recommend the http downloaders over using git, they can resume downloads if failed and are much easier to work with.\
79
+ Make sure to have git and git LFS installed.\
80
+ Example for 3bpw download with git:
81
+
82
+ Have LFS file skip disabled
83
+ ```shell
84
+ # windows
85
+ set GIT_LFS_SKIP_SMUDGE=0
86
+ # linux
87
+ GIT_LFS_SKIP_SMUDGE=0
88
+ ```
89
+
90
+ Clone repo branch
91
+ ```shell
92
+ git clone https://huggingface.co/Anthonyg5005/ReMM-v2.2-L2-13B-exl2 -b 3bit
93
+ ```