prithivMLmods
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -13,13 +13,17 @@ library_name: transformers
|
|
13 |
tags:
|
14 |
- mergekit
|
15 |
- merge
|
16 |
-
|
17 |
---
|
18 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
|
20 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
21 |
|
22 |
-
## Merge Details
|
23 |
### Merge Method
|
24 |
|
25 |
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [unsloth/phi-4](https://huggingface.co/unsloth/phi-4) as a base.
|
|
|
13 |
tags:
|
14 |
- mergekit
|
15 |
- merge
|
|
|
16 |
---
|
17 |
+
# **Phi4-Super**
|
18 |
+
|
19 |
+
[Phi-4-Super finetuned] from Microsoft's Phi-4 is a state-of-the-art open model developed with a focus on responsible problem solving and advanced reasoning capabilities. Built upon a diverse blend of synthetic datasets, carefully filtered public domain websites, and high-quality academic books and Q&A datasets, Phi-4-QwQ ensures that small, capable models are trained with datasets of exceptional depth and precision.
|
20 |
+
|
21 |
+
Phi-4-Super adopts a robust safety post-training approach using open-source and in-house synthetic datasets. This involves a combination of SFT (Supervised Fine-Tuning) and iterative DPO (Direct Preference Optimization) techniques, ensuring helpful and harmless outputs across various safety categories.
|
22 |
+
|
23 |
+
# Merge
|
24 |
|
25 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
26 |
|
|
|
27 |
### Merge Method
|
28 |
|
29 |
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [unsloth/phi-4](https://huggingface.co/unsloth/phi-4) as a base.
|