Update README.md
Browse files
README.md
CHANGED
@@ -1,15 +1,16 @@
|
|
1 |
---
|
2 |
-
base_model: unsloth/Llama-3.2-1B-Instruct-bnb-4bit
|
3 |
tags:
|
4 |
- text-generation-inference
|
5 |
- transformers
|
6 |
- unsloth
|
7 |
- llama
|
8 |
- gguf
|
9 |
-
- ollama
|
10 |
-
license: apache-2.0
|
11 |
language:
|
12 |
- en
|
|
|
13 |
---
|
14 |
|
15 |
# kubectl Operator Model
|
@@ -20,7 +21,7 @@ language:
|
|
20 |
- **Model type:** GGUF (compatible with Ollama)
|
21 |
- **Language:** English
|
22 |
|
23 |
-
This Llama-based model was fine-tuned to generate `kubectl` commands based on user descriptions. It was trained
|
24 |
|
25 |
---
|
26 |
|
@@ -30,9 +31,9 @@ This Llama-based model was fine-tuned to generate `kubectl` commands based on us
|
|
30 |
|
31 |
The model assists users by:
|
32 |
|
33 |
-
- Generating accurate `kubectl` commands based on natural language descriptions.
|
34 |
-
- Providing brief explanations about Kubernetes for general queries.
|
35 |
-
- Requesting additional information if the instruction is incomplete or ambiguous.
|
36 |
|
37 |
### Intended Users
|
38 |
|
@@ -44,14 +45,13 @@ The model assists users by:
|
|
44 |
|
45 |
- **Base Model:** Unsloth's Llama-3.2-1B-Instruct-bnb-4bit
|
46 |
- **Fine-tuning:** Leveraged the Unsloth framework and Hugging Face's TRL library for efficient training.
|
47 |
-
- **Training Data:** Customized
|
48 |
-
|
49 |
-
### Performance
|
50 |
|
51 |
-
|
52 |
|
53 |
-
-
|
54 |
-
-
|
|
|
55 |
|
56 |
---
|
57 |
|
@@ -62,19 +62,53 @@ While the model aims to generate accurate commands, there might be occasional ha
|
|
62 |
The model uses the following prompt template to generate responses:
|
63 |
|
64 |
```plaintext
|
65 |
-
You are an AI assistant that
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
66 |
|
67 |
### Instruction:
|
68 |
-
|
69 |
|
70 |
### Response:
|
71 |
-
|
72 |
-
</s>
|
73 |
```
|
74 |
|
75 |
### Parameters
|
76 |
|
77 |
-
- **Temperature:** `0.3` (controls
|
78 |
- **Stop Token:** `</s>` (indicates the end of the assistant's response)
|
79 |
|
80 |
---
|
@@ -86,14 +120,13 @@ You are an AI assistant that generates kubectl commands based on the user's desc
|
|
86 |
**Instruction:**
|
87 |
|
88 |
```
|
89 |
-
|
90 |
```
|
91 |
|
92 |
**Response:**
|
93 |
|
94 |
-
```
|
95 |
-
kubectl
|
96 |
-
</s>
|
97 |
```
|
98 |
|
99 |
---
|
@@ -103,14 +136,13 @@ kubectl get pods -n kube-system
|
|
103 |
**Instruction:**
|
104 |
|
105 |
```
|
106 |
-
|
107 |
```
|
108 |
|
109 |
**Response:**
|
110 |
|
111 |
```
|
112 |
-
|
113 |
-
</s>
|
114 |
```
|
115 |
|
116 |
---
|
@@ -120,14 +152,13 @@ Could you please specify the name of the deployment you want to restart?
|
|
120 |
**Instruction:**
|
121 |
|
122 |
```
|
123 |
-
What is a Kubernetes
|
124 |
```
|
125 |
|
126 |
**Response:**
|
127 |
|
128 |
```
|
129 |
-
A
|
130 |
-
</s>
|
131 |
```
|
132 |
|
133 |
---
|
@@ -137,32 +168,99 @@ A Kubernetes Service is an abstraction that defines a logical set of Pods and a
|
|
137 |
### Prerequisites
|
138 |
|
139 |
- Install [Ollama](https://github.com/jmorganca/ollama) on your system.
|
140 |
-
- Ensure you have the GGUF model file (`kubectl_operator.Q8_0.gguf`).
|
141 |
|
142 |
### Steps
|
143 |
|
144 |
1. **Create the Modelfile**
|
145 |
|
146 |
-
Save the following content as a file named `
|
147 |
|
148 |
```plaintext
|
149 |
FROM kubectl_operator.Q8_0.gguf
|
150 |
|
151 |
-
SYSTEM "You are an AI assistant that
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
152 |
|
153 |
-
|
154 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
155 |
|
156 |
TEMPLATE """
|
157 |
-
You are an AI assistant that
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
158 |
|
159 |
### Instruction:
|
160 |
{{ .Prompt }}
|
161 |
|
162 |
### Response:
|
163 |
-
{{ .Response }}
|
164 |
-
</s>
|
165 |
"""
|
|
|
166 |
```
|
167 |
|
168 |
2. **Create the Model with Ollama**
|
@@ -170,10 +268,10 @@ A Kubernetes Service is an abstraction that defines a logical set of Pods and a
|
|
170 |
Open your terminal and run the following command to create the model:
|
171 |
|
172 |
```bash
|
173 |
-
ollama create kubectl_operator -f
|
174 |
```
|
175 |
|
176 |
-
This command tells Ollama to create a new model named `kubectl_operator` using the configuration specified in `
|
177 |
|
178 |
3. **Run the Model**
|
179 |
|
@@ -189,8 +287,8 @@ A Kubernetes Service is an abstraction that defines a logical set of Pods and a
|
|
189 |
|
190 |
## Limitations and Considerations
|
191 |
|
192 |
-
- **Accuracy:** The model may occasionally produce incorrect or suboptimal commands. Always review the output before
|
193 |
-
- **Hallucinations:** In rare cases, the model might generate irrelevant information. If the response seems off-topic, consider rephrasing your instruction.
|
194 |
- **Security:** Be cautious when executing generated commands, especially in production environments.
|
195 |
|
196 |
---
|
|
|
1 |
---
|
2 |
+
base_model: unsloth/Llama-3.2-1B-Instruct-bnb-4bit
|
3 |
tags:
|
4 |
- text-generation-inference
|
5 |
- transformers
|
6 |
- unsloth
|
7 |
- llama
|
8 |
- gguf
|
9 |
+
- ollama
|
10 |
+
license: apache-2.0
|
11 |
language:
|
12 |
- en
|
13 |
+
|
14 |
---
|
15 |
|
16 |
# kubectl Operator Model
|
|
|
21 |
- **Model type:** GGUF (compatible with Ollama)
|
22 |
- **Language:** English
|
23 |
|
24 |
+
This Llama-based model was fine-tuned to generate `kubectl` commands based on user descriptions. It was trained efficiently using [Unsloth](https://github.com/unslothai/unsloth) and Hugging Face's TRL library.
|
25 |
|
26 |
---
|
27 |
|
|
|
31 |
|
32 |
The model assists users by:
|
33 |
|
34 |
+
- **Generating accurate `kubectl` commands** based on natural language descriptions.
|
35 |
+
- **Providing brief explanations about Kubernetes** for general queries.
|
36 |
+
- **Requesting additional information** if the instruction is incomplete or ambiguous.
|
37 |
|
38 |
### Intended Users
|
39 |
|
|
|
45 |
|
46 |
- **Base Model:** Unsloth's Llama-3.2-1B-Instruct-bnb-4bit
|
47 |
- **Fine-tuning:** Leveraged the Unsloth framework and Hugging Face's TRL library for efficient training.
|
48 |
+
- **Training Data:** Customized dataset focused on Kubernetes operations and `kubectl` command usage, containing approximately 200 entries.
|
|
|
|
|
49 |
|
50 |
+
### Features
|
51 |
|
52 |
+
- **Command Generation:** Translates user instructions into executable `kubectl` commands.
|
53 |
+
- **Clarification Requests:** Politely asks for more details when the instruction is incomplete.
|
54 |
+
- **Knowledge Base:** Provides concise explanations for general Kubernetes concepts.
|
55 |
|
56 |
---
|
57 |
|
|
|
62 |
The model uses the following prompt template to generate responses:
|
63 |
|
64 |
```plaintext
|
65 |
+
You are an AI assistant that helps users with Kubernetes commands and questions.
|
66 |
+
|
67 |
+
**Your Behavior Guidelines:**
|
68 |
+
|
69 |
+
1. **For clear and complete instructions:**
|
70 |
+
- **Provide only** the exact `kubectl` command needed to fulfill the user's request.
|
71 |
+
- Do not include extra explanations, placeholders, or context.
|
72 |
+
- **Enclose the command within a code block** with `bash` syntax highlighting.
|
73 |
+
|
74 |
+
2. **For incomplete or ambiguous instructions:**
|
75 |
+
- **Politely ask** the user for the specific missing information.
|
76 |
+
- Do **not** provide any commands or placeholders in your response.
|
77 |
+
- Respond in plain text, clearly stating what information is needed.
|
78 |
+
|
79 |
+
3. **For general Kubernetes questions:**
|
80 |
+
- Provide a **concise and accurate explanation**.
|
81 |
+
- Do **not** include any commands unless specifically requested.
|
82 |
+
- Ensure that the explanation fully addresses the user's question.
|
83 |
+
|
84 |
+
**Important Rules:**
|
85 |
+
|
86 |
+
- Do **not** generate commands with placeholders like `<pod_name>` or `<resource_name>`.
|
87 |
+
- Always ensure that commands provided are **valid and executable** as-is.
|
88 |
+
- If unsure or the instruction is unclear, **ask for clarification** without including any commands.
|
89 |
+
- Do **not** output any additional text beyond what's necessary.
|
90 |
+
|
91 |
+
**Formatting:**
|
92 |
+
|
93 |
+
- **Commands**: Use code blocks with `bash` syntax:
|
94 |
+
```bash
|
95 |
+
kubectl <command>
|
96 |
+
```
|
97 |
+
|
98 |
+
- **Clarifications and Explanations**: Respond in plain text, politely and clearly.
|
99 |
+
|
100 |
+
---
|
101 |
|
102 |
### Instruction:
|
103 |
+
{instruction}
|
104 |
|
105 |
### Response:
|
106 |
+
{response}
|
|
|
107 |
```
|
108 |
|
109 |
### Parameters
|
110 |
|
111 |
+
- **Temperature:** `0.3` (controls randomness; lower values make outputs more deterministic)
|
112 |
- **Stop Token:** `</s>` (indicates the end of the assistant's response)
|
113 |
|
114 |
---
|
|
|
120 |
**Instruction:**
|
121 |
|
122 |
```
|
123 |
+
Create a namespace called 'development'.
|
124 |
```
|
125 |
|
126 |
**Response:**
|
127 |
|
128 |
+
```bash
|
129 |
+
kubectl create namespace development
|
|
|
130 |
```
|
131 |
|
132 |
---
|
|
|
136 |
**Instruction:**
|
137 |
|
138 |
```
|
139 |
+
Show me logs.
|
140 |
```
|
141 |
|
142 |
**Response:**
|
143 |
|
144 |
```
|
145 |
+
Which pod's logs would you like to retrieve?
|
|
|
146 |
```
|
147 |
|
148 |
---
|
|
|
152 |
**Instruction:**
|
153 |
|
154 |
```
|
155 |
+
What is a Deployment in Kubernetes?
|
156 |
```
|
157 |
|
158 |
**Response:**
|
159 |
|
160 |
```
|
161 |
+
A Deployment provides declarative updates for Pods and ReplicaSets, allowing you to manage your applications by defining the desired state and letting Kubernetes handle the rest.
|
|
|
162 |
```
|
163 |
|
164 |
---
|
|
|
168 |
### Prerequisites
|
169 |
|
170 |
- Install [Ollama](https://github.com/jmorganca/ollama) on your system.
|
171 |
+
- Ensure you have the GGUF model file (e.g., `kubectl_operator.Q8_0.gguf`).
|
172 |
|
173 |
### Steps
|
174 |
|
175 |
1. **Create the Modelfile**
|
176 |
|
177 |
+
Save the following content as a file named `Modelfile`:
|
178 |
|
179 |
```plaintext
|
180 |
FROM kubectl_operator.Q8_0.gguf
|
181 |
|
182 |
+
SYSTEM "You are an AI assistant that helps users with Kubernetes commands and questions.
|
183 |
+
|
184 |
+
**Your Behavior Guidelines:**
|
185 |
+
|
186 |
+
1. **For clear and complete instructions:**
|
187 |
+
- **Provide only** the exact `kubectl` command needed to fulfill the user's request.
|
188 |
+
- Do not include extra explanations, placeholders, or context.
|
189 |
+
- **Enclose the command within a code block** with `bash` syntax highlighting.
|
190 |
+
|
191 |
+
2. **For incomplete or ambiguous instructions:**
|
192 |
+
- **Politely ask** the user for the specific missing information.
|
193 |
+
- Do **not** provide any commands or placeholders in your response.
|
194 |
+
- Respond in plain text, clearly stating what information is needed.
|
195 |
|
196 |
+
3. **For general Kubernetes questions:**
|
197 |
+
- Provide a **concise and accurate explanation**.
|
198 |
+
- Do **not** include any commands unless specifically requested.
|
199 |
+
- Ensure that the explanation fully addresses the user's question.
|
200 |
+
|
201 |
+
**Important Rules:**
|
202 |
+
|
203 |
+
- Do **not** generate commands with placeholders like `<pod_name>` or `<resource_name>`.
|
204 |
+
- Always ensure that commands provided are **valid and executable** as-is.
|
205 |
+
- If unsure or the instruction is unclear, **ask for clarification** without including any commands.
|
206 |
+
- Do **not** output any additional text beyond what's necessary.
|
207 |
+
|
208 |
+
**Formatting:**
|
209 |
+
|
210 |
+
- **Commands**: Use code blocks with `bash` syntax:
|
211 |
+
```bash
|
212 |
+
kubectl <command>
|
213 |
+
```
|
214 |
+
|
215 |
+
- **Clarifications and Explanations**: Respond in plain text, politely and clearly."
|
216 |
+
|
217 |
+
PARAMETER --temperature 0.3
|
218 |
+
PARAMETER --stop "\n</s>"
|
219 |
|
220 |
TEMPLATE """
|
221 |
+
You are an AI assistant that helps users with Kubernetes commands and questions.
|
222 |
+
|
223 |
+
**Your Behavior Guidelines:**
|
224 |
+
|
225 |
+
1. **For clear and complete instructions:**
|
226 |
+
- **Provide only** the exact `kubectl` command needed to fulfill the user's request.
|
227 |
+
- Do not include extra explanations, placeholders, or context.
|
228 |
+
- **Enclose the command within a code block** with `bash` syntax highlighting.
|
229 |
+
|
230 |
+
2. **For incomplete or ambiguous instructions:**
|
231 |
+
- **Politely ask** the user for the specific missing information.
|
232 |
+
- Do **not** provide any commands or placeholders in your response.
|
233 |
+
- Respond in plain text, clearly stating what information is needed.
|
234 |
+
|
235 |
+
3. **For general Kubernetes questions:**
|
236 |
+
- Provide a **concise and accurate explanation**.
|
237 |
+
- Do **not** include any commands unless specifically requested.
|
238 |
+
- Ensure that the explanation fully addresses the user's question.
|
239 |
+
|
240 |
+
**Important Rules:**
|
241 |
+
|
242 |
+
- Do **not** generate commands with placeholders like `<pod_name>` or `<resource_name>`.
|
243 |
+
- Always ensure that commands provided are **valid and executable** as-is.
|
244 |
+
- If unsure or the instruction is unclear, **ask for clarification** without including any commands.
|
245 |
+
- Do **not** output any additional text beyond what's necessary.
|
246 |
+
|
247 |
+
**Formatting:**
|
248 |
+
|
249 |
+
- **Commands**: Use code blocks with `bash` syntax:
|
250 |
+
```bash
|
251 |
+
kubectl <command>
|
252 |
+
```
|
253 |
+
|
254 |
+
- **Clarifications and Explanations**: Respond in plain text, politely and clearly.
|
255 |
+
|
256 |
+
---
|
257 |
|
258 |
### Instruction:
|
259 |
{{ .Prompt }}
|
260 |
|
261 |
### Response:
|
|
|
|
|
262 |
"""
|
263 |
+
|
264 |
```
|
265 |
|
266 |
2. **Create the Model with Ollama**
|
|
|
268 |
Open your terminal and run the following command to create the model:
|
269 |
|
270 |
```bash
|
271 |
+
ollama create kubectl_operator -f Modelfile
|
272 |
```
|
273 |
|
274 |
+
This command tells Ollama to create a new model named `kubectl_operator` using the configuration specified in `Modelfile`.
|
275 |
|
276 |
3. **Run the Model**
|
277 |
|
|
|
287 |
|
288 |
## Limitations and Considerations
|
289 |
|
290 |
+
- **Accuracy:** The model may occasionally produce incorrect or suboptimal commands. Always review the output before execution.
|
291 |
+
- **Hallucinations:** In rare cases, the model might generate irrelevant or incorrect information. If the response seems off-topic, consider rephrasing your instruction.
|
292 |
- **Security:** Be cautious when executing generated commands, especially in production environments.
|
293 |
|
294 |
---
|