Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,150 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: CrabfishAI/InstructWise-462M
|
3 |
+
datasets:
|
4 |
+
- timdettmers/openassistant-guanaco
|
5 |
+
inference: false
|
6 |
+
language:
|
7 |
+
- en
|
8 |
+
license: llama2
|
9 |
+
model_creator: CrabfishAI
|
10 |
+
model_name: InstructWise-462M
|
11 |
+
pipeline_tag: text-generation
|
12 |
+
quantized_by: afrideva
|
13 |
+
tags:
|
14 |
+
- autotrain
|
15 |
+
- text-generation
|
16 |
+
- gguf
|
17 |
+
- ggml
|
18 |
+
- quantized
|
19 |
+
- q2_k
|
20 |
+
- q3_k_m
|
21 |
+
- q4_k_m
|
22 |
+
- q5_k_m
|
23 |
+
- q6_k
|
24 |
+
- q8_0
|
25 |
+
widget:
|
26 |
+
- text: '### Instruction:
|
27 |
+
|
28 |
+
Find me a list of some nice places to visit around the world.
|
29 |
+
|
30 |
+
|
31 |
+
### Response:'
|
32 |
+
- text: '### Instruction:
|
33 |
+
|
34 |
+
Tell me a story about some magical place.
|
35 |
+
|
36 |
+
|
37 |
+
### Response:'
|
38 |
+
- text: '### Instruction:
|
39 |
+
|
40 |
+
Write a python code to print numbers from 1 to 100 in sequence.
|
41 |
+
|
42 |
+
|
43 |
+
### Response:'
|
44 |
+
- text: '### Instruction:
|
45 |
+
|
46 |
+
What is biology?
|
47 |
+
|
48 |
+
|
49 |
+
### Response:'
|
50 |
+
- text: '### Instruction:
|
51 |
+
|
52 |
+
I love taking photos of nature. Can you come up with a 3-day itinerary visiting
|
53 |
+
the most photogenic places in Iceland?
|
54 |
+
|
55 |
+
|
56 |
+
### Response:'
|
57 |
+
---
|
58 |
+
# CrabfishAI/InstructWise-462M-GGUF
|
59 |
+
|
60 |
+
Quantized GGUF model files for [InstructWise-462M](https://huggingface.co/CrabfishAI/InstructWise-462M) from [CrabfishAI](https://huggingface.co/CrabfishAI)
|
61 |
+
|
62 |
+
|
63 |
+
| Name | Quant method | Size |
|
64 |
+
| ---- | ---- | ---- |
|
65 |
+
| [instructwise-462m.fp16.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.fp16.gguf) | fp16 | 925.45 MB |
|
66 |
+
| [instructwise-462m.q2_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q2_k.gguf) | q2_k | 212.56 MB |
|
67 |
+
| [instructwise-462m.q3_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q3_k_m.gguf) | q3_k_m | 238.87 MB |
|
68 |
+
| [instructwise-462m.q4_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q4_k_m.gguf) | q4_k_m | 288.52 MB |
|
69 |
+
| [instructwise-462m.q5_k_m.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q5_k_m.gguf) | q5_k_m | 333.29 MB |
|
70 |
+
| [instructwise-462m.q6_k.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q6_k.gguf) | q6_k | 380.87 MB |
|
71 |
+
| [instructwise-462m.q8_0.gguf](https://huggingface.co/afrideva/InstructWise-462M-GGUF/resolve/main/instructwise-462m.q8_0.gguf) | q8_0 | 492.67 MB |
|
72 |
+
|
73 |
+
|
74 |
+
|
75 |
+
## Original Model Card:
|
76 |
+
# InstructWise 470M - A virtual assistant.
|
77 |
+
Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
|
78 |
+
Introduction- InstructWise is a model created to act as helpful virtual assistant while maintaing the memory efficiency.
|
79 |
+
# Credits
|
80 |
+
- **Base Model:** ahxt/llama2_xs_460M_experimental
|
81 |
+
- **Dataset used:** timdettmers/openassistant-guanaco
|
82 |
+
- **License:** llama2
|
83 |
+
|
84 |
+
## Features
|
85 |
+
- **Maintaining performance while being memory efficient:** Ram usage- 7.1GB Vram usage- 0.6GB (approximately)
|
86 |
+
- **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
|
87 |
+
- **Coding:** Model can perform coding as well.
|
88 |
+
- **Assisting capabilities:** can assist with wide rang of taskes.
|
89 |
+
|
90 |
+
## Uses
|
91 |
+
|
92 |
+
InstructWise finds application in various domains, including:
|
93 |
+
|
94 |
+
- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
|
95 |
+
- **Chatbot Development:** Power conversational agents with human-like responses.
|
96 |
+
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
|
97 |
+
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
|
98 |
+
and many more.
|
99 |
+
|
100 |
+
## Direct Use Cases
|
101 |
+
|
102 |
+
InstructWise can be directly employed for:
|
103 |
+
|
104 |
+
1. **Educational Support:**
|
105 |
+
- Assist users in learning new topics with detailed explanations and step-by-step instructions.
|
106 |
+
|
107 |
+
2. **Content Creation:**
|
108 |
+
- Generate creative content based on prompts, aiding content creators in the writing process.
|
109 |
+
|
110 |
+
3. **Code Assistance:**
|
111 |
+
- Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.
|
112 |
+
|
113 |
+
4. **Interactive Conversations:**
|
114 |
+
- Enhance chatbots or virtual assistants with informative and helpful responses for users.
|
115 |
+
|
116 |
+
5. **Q&A Platforms:**
|
117 |
+
- Power question and answer platforms, offering detailed and insightful answers on various topics.
|
118 |
+
|
119 |
+
6. **Technical Writing Support:**
|
120 |
+
- Assist writers and technical communicators with suggestions for clarity and informativeness.
|
121 |
+
|
122 |
+
7. **Idea Expansion:**
|
123 |
+
- Facilitate the expansion and development of ideas by providing detailed insights and suggestions.
|
124 |
+
|
125 |
+
|
126 |
+
## Limitation
|
127 |
+
|
128 |
+
1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.
|
129 |
+
|
130 |
+
2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.
|
131 |
+
|
132 |
+
3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.
|
133 |
+
|
134 |
+
|
135 |
+
|
136 |
+
## Disclaimer
|
137 |
+
|
138 |
+
- **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.
|
139 |
+
|
140 |
+
- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.
|
141 |
+
|
142 |
+
- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.
|
143 |
+
|
144 |
+
## Recommended Prompt Format to use:
|
145 |
+
```
|
146 |
+
### Instruction:
|
147 |
+
<instruction>
|
148 |
+
|
149 |
+
### Response:
|
150 |
+
```
|