|
|
--- |
|
|
base_model: remyxai/stablelm-zephyr-3B_localmentor |
|
|
license: apache-2.0 |
|
|
language: |
|
|
- en |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- stablelm |
|
|
- zephyr |
|
|
- gguf |
|
|
library_name: llama.cpp |
|
|
model_creator: remyxai |
|
|
model_name: stablelm-zephyr-3B_localmentor |
|
|
model_type: stablelm |
|
|
prompt_template: | |
|
|
<|system|> |
|
|
{system_prompt}</s> |
|
|
<|user|> |
|
|
{prompt}</s> |
|
|
<|assistant|> |
|
|
quantized_by: mgonzs13 |
|
|
--- |
|
|
|
|
|
# stablelm-zephyr-3B-localmentor-GGUF |
|
|
|
|
|
**Model creator:** [remyxai](https://huggingface.co/remyxai)<br> |
|
|
**Original model**: [stablelm-zephyr-3B_localmentor](https://huggingface.co/remyxai/stablelm-zephyr-3B_localmentor)<br> |
|
|
**GGUF quantization:** `llama.cpp` commit [fadde6713506d9e6c124f5680ab8c7abebe31837](https://github.com/ggerganov/llama.cpp/tree/fadde6713506d9e6c124f5680ab8c7abebe31837)<br> |
|
|
|
|
|
## Description |
|
|
|
|
|
Fine-tune with low-rank adapters on 25K conversational turns discussing tech/startup from over 800 podcast episodes. |
|
|
|
|
|
- **Developed by:** [Remyx.AI](https://huggingface.co/remyxai) |
|
|
- **License:** apache-2.0 |
|
|
- **Finetuned from model:** [stablelm-zephyr-3b](https://huggingface.co/stabilityai/stablelm-zephyr-3b) |
|
|
- **Repository**: https://github.com/remyxai/LocalMentor |
|
|
|
|
|
## Prompt Template |
|
|
|
|
|
Following the [tokenizer_config.json](https://huggingface.co/remyxai/stablelm-zephyr-3B_localmentor/blob/main/tokenizer_config.json), the prompt template is Zephyr. |
|
|
|
|
|
``` |
|
|
<|system|> |
|
|
{system_prompt}</s> |
|
|
<|user|> |
|
|
{prompt}</s> |
|
|
<|assistant|> |
|
|
``` |
|
|
|
