Text Generation
Transformers
Safetensors
English
mistral
Trained with AutoTrain
text-generation-inference
Inference Endpoints
InstructWise2-248M / README.md
Sirclavin's picture
Update README.md
9af1946
---
tags:
- autotrain
- text-generation
base_model: Locutusque/TinyMistral-248M
datasets:
- CrabfishAI/ReasoningQuestions
- OpenAssistant/oasst_top1_2023-08-25
- nRuaif/OpenOrca-GPT3.5
widget:
- text: |-
<|im_start|>user
Find me a list of some nice places to visit around the world.<|im_end|>
<|im_start|>assistant
- text: |-
<|im_start|>user
Tell me a story about some magical place.<|im_end|>
<|im_start|>assistant
- text: |-
<|im_start|>user
Write a python code to print numbers from 1 to 100 in sequence.<|im_end|>
<|im_start|>assistant
- text: |-
<|im_start|>user
What is biology?<|im_end|>
<|im_start|>assistant
- text: >-
<|im_start|>user
I love taking photos of nature. Can you come up with a 3-day itinerary
visiting the most photogenic places in Iceland?<|im_end|>
<|im_start|>assistant
inference:
parameters:
max_new_tokens: 32
repetition_penalty: 1.15
do_sample: true
temperature: 0.5
top_p: 0.5
license: apache-2.0
language:
- en
---
# InstructWise 470M - A virtual assistant.
- **Update: We're back! with more smaller and better performing model, this time with Mistral this model performs incredibly well when considerd its size, we would strongly recommend to give this model a try.**
- **InstructWise with Llama2 at:** [CrabfishAI/InstructWise-462M](https://huggingface.co/CrabfishAI/InstructWise-462M)
Note- we,ll be releasing more versions of InstructWise soon, with the goal of making memory-efficent models while maintaining the performance, Thank you!
Introduction- InstructWise is a series of model created to act as helpful virtual assistant while maintaing the memory efficiency.
# Credits
- **Base Model:** [Locutusque/TinyMistral-248M](https://huggingface.co/Locutusque/TinyMistral-248M)
- **Dataset Used:** (Mentioned in page)
- **License:** Apache License 2.0
## Features
- **Maintaining performance while being memory efficient:** Ram usage- 5.6GB Vram usage- 0.6GB (approximately)
- **Act as helpful virtual assistant:** InstructWise serves as a versatile and helpful assistant, offering a range of features that cater to various user needs. Its key strength lies in providing instructive responses to user prompts, offering detailed and insightful information.
- **Coding:** Model can perform coding as well.
- **Assisting capabilities:** can assist with wide rang of taskes.
## Uses
InstructWise finds application in various domains, including:
- **Assistance in Writing:** Aid authors, bloggers, and students in drafting articles and essays.
- **Chatbot Development:** Power conversational agents with human-like responses.
- **Prototyping and Idea Generation:** Facilitate brainstorming sessions for product development.
- **Personal Assistant Applications:** Assist users in drafting emails and messages.
and many more.
## Direct Use Cases
InstructWise can be directly employed for:
1. **Educational Support:**
- Assist users in learning new topics with detailed explanations and step-by-step instructions.
2. **Content Creation:**
- Generate creative content based on prompts, aiding content creators in the writing process.
3. **Code Assistance:**
- Provide guidance on coding queries, improve code documentation, and generate code snippets for developers.
4. **Interactive Conversations:**
- Enhance chatbots or virtual assistants with informative and helpful responses for users.
5. **Q&A Platforms:**
- Power question and answer platforms, offering detailed and insightful answers on various topics.
6. **Technical Writing Support:**
- Assist writers and technical communicators with suggestions for clarity and informativeness.
7. **Idea Expansion:**
- Facilitate the expansion and development of ideas by providing detailed insights and suggestions.
## Limitation
1. **Content Quality**: The model's output may vary in quality, and there's a possibility it might generate content that is nonsensical, irrelevant, or grammatically incorrect.
2. **Bias and Sensitivity**: The model is trained on diverse data, but it may inadvertently exhibit biases or generate content that is sensitive or inappropriate. Exercise caution and review generated text before use.
3. **Inappropriate Language**: The model might generate text that includes offensive language or inappropriate content. Be mindful of this, especially in applications where maintaining a respectful and inclusive tone is essential.
## Disclaimer
- **Use with Caution**: This model is a tool that should be used with caution. Always review and validate the generated text before incorporating it into any application or publication.
- **Not for Critical Applications**: Avoid using the model for critical applications where accuracy and reliability are paramount. The model is intended for creative and exploratory purposes.
- **Ongoing Improvement**: The model may be updated or fine-tuned for better performance. Stay informed about updates and consider using the latest version for improved results.
## Recommended Prompt Format to use:
```
<|im_start|>user
[Your prompt here]<|im_end|>
<|im_start|>assistant
```