Text Generation
Transformers
English
Malte0621 commited on
Commit
979738b
·
verified ·
1 Parent(s): 3a0f21d

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. .gitattributes +6 -0
  2. README.md +59 -0
  3. model.gguf +3 -0
  4. model.gguf.123K +3 -0
  5. model.gguf.235K +3 -0
  6. model.gguf.394K +3 -0
  7. model.gguf.66K +3 -0
  8. model.gguf.6M +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ model.gguf filter=lfs diff=lfs merge=lfs -text
37
+ model.gguf.123K filter=lfs diff=lfs merge=lfs -text
38
+ model.gguf.235K filter=lfs diff=lfs merge=lfs -text
39
+ model.gguf.394K filter=lfs diff=lfs merge=lfs -text
40
+ model.gguf.66K filter=lfs diff=lfs merge=lfs -text
41
+ model.gguf.6M filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -1,3 +1,62 @@
1
  ---
 
 
 
 
2
  license: fair-noncommercial-research-license
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ pipeline_tag: text-generation
3
+ library_name: transformers
4
+ language:
5
+ - en
6
  license: fair-noncommercial-research-license
7
+ datasets:
8
+ - malte0621/test-dataset
9
  ---
10
+ # Test Model
11
+ This is a model created for testing purposes. It is one of the smallest models available on Hugging Face, designed to experiment with the capabilities of small/tiny models.
12
+
13
+ ## Model Structure
14
+ The model is structured to handle text generation tasks. It is trained on a small dataset that consists of user prompts and AI responses, allowing it to generate text based on given inputs.
15
+
16
+ ## Usage
17
+ You can use this model for text generation tasks, particularly for testing and experimentation with small models. It is not intended for production use or serious applications.
18
+
19
+ ### Prompt format
20
+ ```
21
+ <|user|>Your input prompt here<|ai|>The model's response will be generated here<|stop|>
22
+ ```
23
+
24
+ ### Example Usage
25
+
26
+
27
+ #### Transformers
28
+ ```python
29
+ from transformers import AutoModelForCausalLM, AutoTokenizer
30
+ model_name = "Malte0621/test-model"
31
+ model = AutoModelForCausalLM.from_pretrained(model_name, gguf_file="model.gguf")
32
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
33
+ prompt = "<|user|>Hi there!<|ai|>"
34
+ response = model.generate(tokenizer(prompt, return_tensors="pt").input_ids)
35
+ print(tokenizer.decode(response[0], skip_special_tokens=True))
36
+ ```
37
+
38
+ #### llama.cpp
39
+ ```bash
40
+ ./llama-cli -m model.gguf -p "<|user|>Hi there!<|ai|>" -n 128 -no-cnv --rope-freq-scale 0.125
41
+ ```
42
+
43
+ #### LM Studio
44
+ https://model.lmstudio.ai/download/Malte0621/test
45
+ **(Make sure to set the RoPE frequency scale to 0.125 in the model settings.)**
46
+
47
+ ## License
48
+ This model is released under the [Fair Noncommercial Research License](https://huggingface.co/Malte0621/test/blob/main/LICENSE).
49
+
50
+ ## Citation
51
+ If you use this model in your research, please cite it as follows:
52
+ ```
53
+ @misc{test-model,
54
+ author = {Malte0621},
55
+ title = {Test-Model},
56
+ year = {2025},
57
+ url = {https://huggingface.co/Malte0621/test}
58
+ }
59
+ ```
60
+
61
+ ## Acknowledgements
62
+ This model was created as part of a personal project to explore the capabilities of small language models. It is not affiliated with any organization or commercial entity.
model.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf991418ac1c294e240a6247d2217c07261d7eb1bc5a4dbece6cd4de039af21f
3
+ size 949568
model.gguf.123K ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3421a08816cea98e63aab4c80b33ef86bf387e770436b9977938edbd1b67a575
3
+ size 502528
model.gguf.235K ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf991418ac1c294e240a6247d2217c07261d7eb1bc5a4dbece6cd4de039af21f
3
+ size 949568
model.gguf.394K ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1506b507322b47c88b696f82001c432a3a3bb286a22eb91760bdb3d8f18421c
3
+ size 1585408
model.gguf.66K ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f9b90ce97f3d68e98c905f537db930ccdb9ca42c9abfd314b09d8b5c58222ee
3
+ size 269184
model.gguf.6M ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70d887e5ed62bbaebef7699ef437d1a566485ad00add3ae713b323f4ab27b224
3
+ size 31227840