prithivMLmods commited on
Commit
7b93312
·
verified ·
1 Parent(s): 0e98789

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -1
README.md CHANGED
@@ -13,4 +13,37 @@ tags:
13
 
14
  # **Demeter-LongCoT-Qwen3-1.7B-GGUF**
15
 
16
- > Demeter-LongCoT-Qwen3-1.7B is a reasoning-focused model fine-tuned on Qwen/Qwen3-1.7B using the Demeter-LongCoT-400K dataset. It is designed for math and code chain-of-thought reasoning, blending symbolic precision, scientific logic, and structured output fluency—making it an effective tool for developers, educators, and researchers seeking reliable step-by-step reasoning.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
  # **Demeter-LongCoT-Qwen3-1.7B-GGUF**
15
 
16
+ > Demeter-LongCoT-Qwen3-1.7B is a reasoning-focused model fine-tuned on Qwen/Qwen3-1.7B using the Demeter-LongCoT-400K dataset. It is designed for math and code chain-of-thought reasoning, blending symbolic precision, scientific logic, and structured output fluency—making it an effective tool for developers, educators, and researchers seeking reliable step-by-step reasoning.
17
+
18
+ ## Model Files
19
+
20
+ | File Name | Quant Type | File Size |
21
+ | - | - | - |
22
+ | Demeter-LongCoT-Qwen-1.7B.BF16.gguf | BF16 | 3.45 GB |
23
+ | Demeter-LongCoT-Qwen-1.7B.F16.gguf | F16 | 3.45 GB |
24
+ | Demeter-LongCoT-Qwen-1.7B.F32.gguf | F32 | 6.89 GB |
25
+ | Demeter-LongCoT-Qwen-1.7B.Q2_K.gguf | Q2_K | 778 MB |
26
+ | Demeter-LongCoT-Qwen-1.7B.Q3_K_L.gguf | Q3_K_L | 1 GB |
27
+ | Demeter-LongCoT-Qwen-1.7B.Q3_K_M.gguf | Q3_K_M | 940 MB |
28
+ | Demeter-LongCoT-Qwen-1.7B.Q3_K_S.gguf | Q3_K_S | 867 MB |
29
+ | Demeter-LongCoT-Qwen-1.7B.Q4_0.gguf | Q4_0 | 1.05 GB |
30
+ | Demeter-LongCoT-Qwen-1.7B.Q4_1.gguf | Q4_1 | 1.14 GB |
31
+ | Demeter-LongCoT-Qwen-1.7B.Q4_K.gguf | Q4_K | 1.11 GB |
32
+ | Demeter-LongCoT-Qwen-1.7B.Q4_K_M.gguf | Q4_K_M | 1.11 GB |
33
+ | Demeter-LongCoT-Qwen-1.7B.Q4_K_S.gguf | Q4_K_S | 1.06 GB |
34
+ | Demeter-LongCoT-Qwen-1.7B.Q5_0.gguf | Q5_0 | 1.23 GB |
35
+ | Demeter-LongCoT-Qwen-1.7B.Q5_1.gguf | Q5_1 | 1.32 GB |
36
+ | Demeter-LongCoT-Qwen-1.7B.Q5_K.gguf | Q5_K | 1.26 GB |
37
+ | Demeter-LongCoT-Qwen-1.7B.Q5_K_M.gguf | Q5_K_M | 1.26 GB |
38
+ | Demeter-LongCoT-Qwen-1.7B.Q5_K_S.gguf | Q5_K_S | 1.23 GB |
39
+ | Demeter-LongCoT-Qwen-1.7B.Q6_K.gguf | Q6_K | 1.42 GB |
40
+ | Demeter-LongCoT-Qwen-1.7B.Q8_0.gguf | Q8_0 | 1.83 GB |
41
+
42
+ ## Quants Usage
43
+
44
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
45
+
46
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
47
+ types (lower is better):
48
+
49
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)