Upload folder using huggingface_hub
Browse files- .gitattributes +6 -0
- README.md +59 -0
- model.gguf +3 -0
- model.gguf.123K +3 -0
- model.gguf.235K +3 -0
- model.gguf.394K +3 -0
- model.gguf.66K +3 -0
- model.gguf.6M +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
model.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
model.gguf.123K filter=lfs diff=lfs merge=lfs -text
|
38 |
+
model.gguf.235K filter=lfs diff=lfs merge=lfs -text
|
39 |
+
model.gguf.394K filter=lfs diff=lfs merge=lfs -text
|
40 |
+
model.gguf.66K filter=lfs diff=lfs merge=lfs -text
|
41 |
+
model.gguf.6M filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -1,3 +1,62 @@
|
|
1 |
---
|
|
|
|
|
|
|
|
|
2 |
license: fair-noncommercial-research-license
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
pipeline_tag: text-generation
|
3 |
+
library_name: transformers
|
4 |
+
language:
|
5 |
+
- en
|
6 |
license: fair-noncommercial-research-license
|
7 |
+
datasets:
|
8 |
+
- malte0621/test-dataset
|
9 |
---
|
10 |
+
# Test Model
|
11 |
+
This is a model created for testing purposes. It is one of the smallest models available on Hugging Face, designed to experiment with the capabilities of small/tiny models.
|
12 |
+
|
13 |
+
## Model Structure
|
14 |
+
The model is structured to handle text generation tasks. It is trained on a small dataset that consists of user prompts and AI responses, allowing it to generate text based on given inputs.
|
15 |
+
|
16 |
+
## Usage
|
17 |
+
You can use this model for text generation tasks, particularly for testing and experimentation with small models. It is not intended for production use or serious applications.
|
18 |
+
|
19 |
+
### Prompt format
|
20 |
+
```
|
21 |
+
<|user|>Your input prompt here<|ai|>The model's response will be generated here<|stop|>
|
22 |
+
```
|
23 |
+
|
24 |
+
### Example Usage
|
25 |
+
|
26 |
+
|
27 |
+
#### Transformers
|
28 |
+
```python
|
29 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
30 |
+
model_name = "Malte0621/test-model"
|
31 |
+
model = AutoModelForCausalLM.from_pretrained(model_name, gguf_file="model.gguf")
|
32 |
+
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
33 |
+
prompt = "<|user|>Hi there!<|ai|>"
|
34 |
+
response = model.generate(tokenizer(prompt, return_tensors="pt").input_ids)
|
35 |
+
print(tokenizer.decode(response[0], skip_special_tokens=True))
|
36 |
+
```
|
37 |
+
|
38 |
+
#### llama.cpp
|
39 |
+
```bash
|
40 |
+
./llama-cli -m model.gguf -p "<|user|>Hi there!<|ai|>" -n 128 -no-cnv --rope-freq-scale 0.125
|
41 |
+
```
|
42 |
+
|
43 |
+
#### LM Studio
|
44 |
+
https://model.lmstudio.ai/download/Malte0621/test
|
45 |
+
**(Make sure to set the RoPE frequency scale to 0.125 in the model settings.)**
|
46 |
+
|
47 |
+
## License
|
48 |
+
This model is released under the [Fair Noncommercial Research License](https://huggingface.co/Malte0621/test/blob/main/LICENSE).
|
49 |
+
|
50 |
+
## Citation
|
51 |
+
If you use this model in your research, please cite it as follows:
|
52 |
+
```
|
53 |
+
@misc{test-model,
|
54 |
+
author = {Malte0621},
|
55 |
+
title = {Test-Model},
|
56 |
+
year = {2025},
|
57 |
+
url = {https://huggingface.co/Malte0621/test}
|
58 |
+
}
|
59 |
+
```
|
60 |
+
|
61 |
+
## Acknowledgements
|
62 |
+
This model was created as part of a personal project to explore the capabilities of small language models. It is not affiliated with any organization or commercial entity.
|
model.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cf991418ac1c294e240a6247d2217c07261d7eb1bc5a4dbece6cd4de039af21f
|
3 |
+
size 949568
|
model.gguf.123K
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3421a08816cea98e63aab4c80b33ef86bf387e770436b9977938edbd1b67a575
|
3 |
+
size 502528
|
model.gguf.235K
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:cf991418ac1c294e240a6247d2217c07261d7eb1bc5a4dbece6cd4de039af21f
|
3 |
+
size 949568
|
model.gguf.394K
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:c1506b507322b47c88b696f82001c432a3a3bb286a22eb91760bdb3d8f18421c
|
3 |
+
size 1585408
|
model.gguf.66K
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4f9b90ce97f3d68e98c905f537db930ccdb9ca42c9abfd314b09d8b5c58222ee
|
3 |
+
size 269184
|
model.gguf.6M
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:70d887e5ed62bbaebef7699ef437d1a566485ad00add3ae713b323f4ab27b224
|
3 |
+
size 31227840
|