style(docs): update README.md
Browse files
README.md
CHANGED
@@ -7,4 +7,220 @@ language:
|
|
7 |
- en
|
8 |
base_model:
|
9 |
- unsloth/Qwen2.5-3B-Instruct-bnb-4bit
|
10 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
- en
|
8 |
base_model:
|
9 |
- unsloth/Qwen2.5-3B-Instruct-bnb-4bit
|
10 |
+
---
|
11 |
+
|
12 |
+
# Kubernetes Feature Model
|
13 |
+
|
14 |
+
- **License:** Apache-2.0
|
15 |
+
- **Fine-tuned from model:** [unsloth/Qwen-2.5-3B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Qwen-2.5-3B-Instruct-bnb-4bit)
|
16 |
+
- **Model type:** GGUF (compatible with Ollama)
|
17 |
+
- **Language:** English
|
18 |
+
|
19 |
+
This Qwen-based model was fine-tuned to assist users with Kubernetes commands and questions. It has three primary features:
|
20 |
+
|
21 |
+
1. **Generating accurate `kubectl` commands** based on user descriptions.
|
22 |
+
2. **Providing concise explanations about Kubernetes** for general queries.
|
23 |
+
3. **Politely requesting additional information** if the instruction is incomplete or ambiguous.
|
24 |
+
|
25 |
+
**Update:** Compared to the previous 1B model, the **3B model significantly reduces hallucinations** that sometimes occurred in the 1B model. Users can expect improved accuracy and reliability when interacting with this model.
|
26 |
+
|
27 |
+
The model was trained efficiently using [Unsloth](https://github.com/unslothai/unsloth) and Hugging Face's TRL library.
|
28 |
+
|
29 |
+
---
|
30 |
+
|
31 |
+
## How to Use the Model
|
32 |
+
|
33 |
+
This section provides instructions on how to run the model using Ollama and the provided Modelfile.
|
34 |
+
|
35 |
+
### Prerequisites
|
36 |
+
|
37 |
+
- Install [Ollama](https://github.com/jmorganca/ollama) on your system.
|
38 |
+
- Ensure you have access to the model hosted on Hugging Face: `hf.co/zhenyangzhao/Qwen2.5-3B-Instruct-Kubernetes`.
|
39 |
+
|
40 |
+
### Steps
|
41 |
+
|
42 |
+
1. **Create the Modelfile**
|
43 |
+
|
44 |
+
Save the following content as a file named `Modelfile`:
|
45 |
+
|
46 |
+
```plaintext
|
47 |
+
FROM hf.co/zhenyangzhao/Qwen2.5-3B-Instruct-Kubernetes
|
48 |
+
PARAMETER temperature 0.3
|
49 |
+
PARAMETER stop "</s>"
|
50 |
+
TEMPLATE """
|
51 |
+
You are an AI assistant that helps users with Kubernetes commands and questions.
|
52 |
+
**Your Behavior Guidelines:**
|
53 |
+
1. **For clear and complete instructions:**
|
54 |
+
- **Provide only** the exact `kubectl` command needed to fulfill the user's request.
|
55 |
+
- Do not include extra explanations, placeholders, or context.
|
56 |
+
- **Enclose the command within a code block** with `bash` syntax highlighting.
|
57 |
+
2. **For incomplete or ambiguous instructions:**
|
58 |
+
- **Politely ask** the user for the specific missing information.
|
59 |
+
- Do **not** provide any commands or placeholders in your response.
|
60 |
+
- Respond in plain text, clearly stating what information is needed.
|
61 |
+
3. **For general Kubernetes questions:**
|
62 |
+
- Provide a **concise and accurate explanation**.
|
63 |
+
- Do **not** include any commands unless specifically requested.
|
64 |
+
- Ensure that the explanation fully addresses the user's question.
|
65 |
+
**Important Rules:**
|
66 |
+
- **Do not generate CLI commands containing placeholders (e.g., <pod_name>, <resource_name>).**
|
67 |
+
- Ensure all CLI commands are complete, valid, and executable as provided.
|
68 |
+
- If user input is insufficient to form a complete command, ask for clarification instead of using placeholders.
|
69 |
+
- Provide only the necessary CLI command output without any additional text.
|
70 |
+
### Instruction:
|
71 |
+
{{ .Prompt }}
|
72 |
+
### Response:
|
73 |
+
{{ .Response }}
|
74 |
+
</s>
|
75 |
+
"""
|
76 |
+
```
|
77 |
+
|
78 |
+
2. **Create the Model with Ollama**
|
79 |
+
|
80 |
+
Open your terminal and run the following command to create the model:
|
81 |
+
|
82 |
+
```bash
|
83 |
+
ollama create kubernetes_feature_model -f Modelfile
|
84 |
+
```
|
85 |
+
|
86 |
+
This command tells Ollama to create a new model named `hybrid_kubernetes_feature_model` using the configuration specified in `Modelfile`.
|
87 |
+
|
88 |
+
3. **Run the Model**
|
89 |
+
|
90 |
+
Start interacting with your model:
|
91 |
+
|
92 |
+
```bash
|
93 |
+
ollama run kubernetes_feature_model
|
94 |
+
```
|
95 |
+
|
96 |
+
This will initiate the model and prompt you for input based on the template provided.
|
97 |
+
|
98 |
+
Alternatively, you can provide an instruction directly:
|
99 |
+
|
100 |
+
```bash
|
101 |
+
ollama run kubernetes_feature_model -p "Create a namespace called 'production'."
|
102 |
+
```
|
103 |
+
|
104 |
+
**Example Output:**
|
105 |
+
|
106 |
+
```bash
|
107 |
+
kubectl create namespace production
|
108 |
+
```
|
109 |
+
|
110 |
+
---
|
111 |
+
|
112 |
+
## Model Details
|
113 |
+
|
114 |
+
### Purpose
|
115 |
+
|
116 |
+
The model assists users by:
|
117 |
+
|
118 |
+
- **Generating accurate `kubectl` commands** based on natural language descriptions.
|
119 |
+
- **Providing concise explanations about Kubernetes** for general queries.
|
120 |
+
- **Politely requesting additional information** if the instruction is incomplete or ambiguous.
|
121 |
+
|
122 |
+
### Intended Users
|
123 |
+
|
124 |
+
- Kubernetes administrators
|
125 |
+
- DevOps engineers
|
126 |
+
- Developers working with Kubernetes clusters
|
127 |
+
|
128 |
+
### Training Process
|
129 |
+
|
130 |
+
- **Base Model:** Unsloth's Qwen2.5-3B-Instruct
|
131 |
+
- **Fine-tuning:** Leveraged the Unsloth framework and Hugging Face's TRL library for efficient training.
|
132 |
+
- **Training Data:** Customized dataset focused on Kubernetes operations and features, including `kubectl` command usage and general Kubernetes concepts, containing approximately 1,500 entries.
|
133 |
+
|
134 |
+
---
|
135 |
+
|
136 |
+
## Model Features
|
137 |
+
|
138 |
+
### 1. Command Generation in Bash Format
|
139 |
+
|
140 |
+
When the model generates CLI commands, it provides them in `bash` format, enclosed within code blocks for easy execution and clarity. This allows users to copy and paste the commands directly into their terminal.
|
141 |
+
|
142 |
+
### 2. Handling Ambiguity with Polite Clarifications
|
143 |
+
|
144 |
+
If the instruction is incomplete or ambiguous, the model will politely ask for the specific missing information instead of making assumptions. This ensures accuracy and prevents the execution of incorrect commands.
|
145 |
+
|
146 |
+
### 3. Providing Concise Explanations
|
147 |
+
|
148 |
+
For general Kubernetes questions, the model offers concise and accurate explanations without unnecessary details, helping users understand concepts quickly.
|
149 |
+
|
150 |
+
### 4. Enhanced Accuracy with 3B Model
|
151 |
+
|
152 |
+
The transition to the 3B model has significantly **reduced hallucinations** that sometimes occurred in the 1B model. The 3B model provides more accurate and reliable responses, improving the overall user experience.
|
153 |
+
|
154 |
+
---
|
155 |
+
|
156 |
+
## Examples
|
157 |
+
|
158 |
+
### Example 1: Generating a Command
|
159 |
+
|
160 |
+
**Instruction:**
|
161 |
+
|
162 |
+
```
|
163 |
+
Create a namespace called 'development'.
|
164 |
+
```
|
165 |
+
|
166 |
+
**Response:**
|
167 |
+
|
168 |
+
```bash
|
169 |
+
kubectl create namespace development
|
170 |
+
```
|
171 |
+
|
172 |
+
---
|
173 |
+
|
174 |
+
### Example 2: Handling Ambiguity
|
175 |
+
|
176 |
+
**Instruction:**
|
177 |
+
|
178 |
+
```
|
179 |
+
Show me logs.
|
180 |
+
```
|
181 |
+
|
182 |
+
**Response:**
|
183 |
+
|
184 |
+
```
|
185 |
+
Which pod's logs would you like to retrieve?
|
186 |
+
```
|
187 |
+
|
188 |
+
---
|
189 |
+
|
190 |
+
### Example 3: Providing Explanations
|
191 |
+
|
192 |
+
**Instruction:**
|
193 |
+
|
194 |
+
```
|
195 |
+
What is a Deployment in Kubernetes?
|
196 |
+
```
|
197 |
+
|
198 |
+
**Response:**
|
199 |
+
|
200 |
+
```
|
201 |
+
A Deployment provides declarative updates for Pods and ReplicaSets, allowing you to manage your applications by defining the desired state and letting Kubernetes handle the rest.
|
202 |
+
```
|
203 |
+
|
204 |
+
---
|
205 |
+
|
206 |
+
## Limitations and Considerations
|
207 |
+
|
208 |
+
- **Accuracy:** While the 3B model improves accuracy, the model may occasionally produce incorrect or suboptimal commands. Always review the output before execution.
|
209 |
+
- **Security:** Be cautious when executing generated commands, especially in production environments.
|
210 |
+
|
211 |
+
---
|
212 |
+
|
213 |
+
## Feedback and Contributions
|
214 |
+
|
215 |
+
We welcome any comments or participation to improve the model and dataset. If you encounter issues or have suggestions for improvement:
|
216 |
+
|
217 |
+
- **GitHub:** [Unsloth Repository](https://github.com/unslothai/unsloth)
|
218 |
+
- **Contact:** Reach out to the developer, **dereklck**, for further assistance.
|
219 |
+
|
220 |
+
---
|
221 |
+
|
222 |
+
**Note:** This model provides assistance in generating Kubernetes commands and explanations based on user input. Always verify the generated commands in a safe environment before executing them in a production cluster.
|
223 |
+
|
224 |
+
---
|
225 |
+
|
226 |
+
If you have any further requests or need additional adjustments, please let me know!
|