Triangle104 commited on
Commit
50fec78
·
verified ·
1 Parent(s): a46282c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +112 -0
README.md ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: transformers
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - shining-valiant
8
+ - shining-valiant-3
9
+ - valiant
10
+ - valiant-labs
11
+ - qwen
12
+ - qwen-3
13
+ - qwen-3-1.7b
14
+ - 1.7b
15
+ - reasoning
16
+ - code
17
+ - code-reasoning
18
+ - science
19
+ - science-reasoning
20
+ - physics
21
+ - biology
22
+ - chemistry
23
+ - earth-science
24
+ - astronomy
25
+ - machine-learning
26
+ - artificial-intelligence
27
+ - compsci
28
+ - computer-science
29
+ - information-theory
30
+ - ML-Ops
31
+ - math
32
+ - cuda
33
+ - deep-learning
34
+ - transformers
35
+ - agentic
36
+ - LLM
37
+ - neuromorphic
38
+ - self-improvement
39
+ - complex-systems
40
+ - cognition
41
+ - linguistics
42
+ - philosophy
43
+ - logic
44
+ - epistemology
45
+ - simulation
46
+ - game-theory
47
+ - knowledge-management
48
+ - creativity
49
+ - problem-solving
50
+ - architect
51
+ - engineer
52
+ - developer
53
+ - creative
54
+ - analytical
55
+ - expert
56
+ - rationality
57
+ - conversational
58
+ - chat
59
+ - instruct
60
+ - llama-cpp
61
+ - gguf-my-repo
62
+ base_model: ValiantLabs/Qwen3-1.7B-ShiningValiant3
63
+ datasets:
64
+ - sequelbox/Celestia3-DeepSeek-R1-0528
65
+ - sequelbox/Mitakihara-DeepSeek-R1-0528
66
+ - sequelbox/Raiden-DeepSeek-R1
67
+ license: apache-2.0
68
+ ---
69
+
70
+ # Triangle104/Qwen3-1.7B-ShiningValiant3-Q8_0-GGUF
71
+ This model was converted to GGUF format from [`ValiantLabs/Qwen3-1.7B-ShiningValiant3`](https://huggingface.co/ValiantLabs/Qwen3-1.7B-ShiningValiant3) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
72
+ Refer to the [original model card](https://huggingface.co/ValiantLabs/Qwen3-1.7B-ShiningValiant3) for more details on the model.
73
+
74
+ ## Use with llama.cpp
75
+ Install llama.cpp through brew (works on Mac and Linux)
76
+
77
+ ```bash
78
+ brew install llama.cpp
79
+
80
+ ```
81
+ Invoke the llama.cpp server or the CLI.
82
+
83
+ ### CLI:
84
+ ```bash
85
+ llama-cli --hf-repo Triangle104/Qwen3-1.7B-ShiningValiant3-Q8_0-GGUF --hf-file qwen3-1.7b-shiningvaliant3-q8_0.gguf -p "The meaning to life and the universe is"
86
+ ```
87
+
88
+ ### Server:
89
+ ```bash
90
+ llama-server --hf-repo Triangle104/Qwen3-1.7B-ShiningValiant3-Q8_0-GGUF --hf-file qwen3-1.7b-shiningvaliant3-q8_0.gguf -c 2048
91
+ ```
92
+
93
+ Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
94
+
95
+ Step 1: Clone llama.cpp from GitHub.
96
+ ```
97
+ git clone https://github.com/ggerganov/llama.cpp
98
+ ```
99
+
100
+ Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
101
+ ```
102
+ cd llama.cpp && LLAMA_CURL=1 make
103
+ ```
104
+
105
+ Step 3: Run inference through the main binary.
106
+ ```
107
+ ./llama-cli --hf-repo Triangle104/Qwen3-1.7B-ShiningValiant3-Q8_0-GGUF --hf-file qwen3-1.7b-shiningvaliant3-q8_0.gguf -p "The meaning to life and the universe is"
108
+ ```
109
+ or
110
+ ```
111
+ ./llama-server --hf-repo Triangle104/Qwen3-1.7B-ShiningValiant3-Q8_0-GGUF --hf-file qwen3-1.7b-shiningvaliant3-q8_0.gguf -c 2048
112
+ ```