emrgnt-cmplxty
commited on
Commit
•
9b3c127
1
Parent(s):
f5af0a1
Update README.md
Browse files
README.md
CHANGED
@@ -4,11 +4,15 @@ license: mit
|
|
4 |
|
5 |
# SciPhi-Self-RAG-Mistral-7B-32k Model Card
|
6 |
|
7 |
-
SciPhi-Self-RAG-Mistral-7B-32k is a Large Language Model (LLM) fine-tuned from Mistral-7B-v0.1. This model underwent the fine-tuning process described in the [SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k) model card. It then underwent further fine-tuning on the recently released [self-rag](https://arxiv.org/abs//2310.11511) dataset. Other RAG-related instruct datasets were mixed in during this process in an effort to keep the tone of the current model. This model benchmarks well but needs further tuning to be an excellent conversationalist.
|
|
|
|
|
|
|
8 |
|
9 |
SciPhi-AI is available via a free hosted API, though the exposed model can vary. Currently, SciPhi-Self-RAG-Mistral-7B-32k is available. More details can be found in the docs [here](https://sciphi.readthedocs.io/en/latest/setup/quickstart.html).
|
10 |
|
11 |
|
|
|
12 |
## Model Architecture
|
13 |
|
14 |
Base Model: Mistral-7B-v0.1
|
|
|
4 |
|
5 |
# SciPhi-Self-RAG-Mistral-7B-32k Model Card
|
6 |
|
7 |
+
SciPhi-Self-RAG-Mistral-7B-32k is a Large Language Model (LLM) fine-tuned from Mistral-7B-v0.1. This model underwent the fine-tuning process described in the [SciPhi-Mistral-7B-32k](https://huggingface.co/SciPhi/SciPhi-Mistral-7B-32k) model card. It then underwent further fine-tuning on the recently released [self-rag](https://arxiv.org/abs//2310.11511) dataset. Other RAG-related instruct datasets were mixed in during this process in an effort to keep the tone of the current model. This model benchmarks well, but it needs further tuning to be an excellent conversationalist.
|
8 |
+
|
9 |
+
Benchmark Results:
|
10 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c806dc4515835c4d7b0b6d/_KV_hXZ0SPkmJUnHudoFz.png)
|
11 |
|
12 |
SciPhi-AI is available via a free hosted API, though the exposed model can vary. Currently, SciPhi-Self-RAG-Mistral-7B-32k is available. More details can be found in the docs [here](https://sciphi.readthedocs.io/en/latest/setup/quickstart.html).
|
13 |
|
14 |
|
15 |
+
|
16 |
## Model Architecture
|
17 |
|
18 |
Base Model: Mistral-7B-v0.1
|