Update README.md
Browse files
README.md
CHANGED
@@ -2,9 +2,89 @@
|
|
2 |
title: README
|
3 |
emoji: 🏢
|
4 |
colorFrom: indigo
|
5 |
-
colorTo:
|
6 |
sdk: static
|
7 |
-
pinned:
|
|
|
8 |
---
|
9 |
|
10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
title: README
|
3 |
emoji: 🏢
|
4 |
colorFrom: indigo
|
5 |
+
colorTo: blue
|
6 |
sdk: static
|
7 |
+
pinned: true
|
8 |
+
license: apache-2.0
|
9 |
---
|
10 |
|
11 |
+
# BiMediX: Bilingual Medical Mixture of Experts LLM
|
12 |
+
|
13 |
+
Welcome to the official HuggingFace repository for BiMediX, the bilingual medical Large Language Model (LLM) designed for English and Arabic interactions. BiMediX facilitates a broad range of medical interactions, including multi-turn chats, multiple-choice Q&A, and open-ended question answering.
|
14 |
+
|
15 |
+
## Key Features
|
16 |
+
|
17 |
+
- **Bilingual Support**: Seamless interaction in both English and Arabic for a wide range of medical interactions, including multi-turn chats, multiple-choice question answering, and open-ended question answering.
|
18 |
+
- **BiMed1.3M Dataset**: Unique dataset with 1.3 million bilingual medical interactions across English and Arabic, including 250k synthesized multi-turn doctor-patient chats for instruction tuning.
|
19 |
+
- **High-Quality Translation** : Utilizes a semi-automated English-to-Arabic translation pipeline with human refinement to ensure accuracy and quality in translations.
|
20 |
+
- **Evaluation Benchmark for Arabic Medical LLMs**: Comprehensive benchmark for evaluating Arabic medical language models, setting a new standard in the field.
|
21 |
+
- **State-of-the-Art Performance**: Significantly outperforms existing models in medical benchmarks, while 8-times faster than existing models.
|
22 |
+
|
23 |
+
|
24 |
+
## Getting Started
|
25 |
+
|
26 |
+
```python
|
27 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
28 |
+
|
29 |
+
model_id = "TODO"
|
30 |
+
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
31 |
+
|
32 |
+
model = AutoModelForCausalLM.from_pretrained(model_id)
|
33 |
+
|
34 |
+
text = "TODO"
|
35 |
+
inputs = tokenizer(text, return_tensors="pt")
|
36 |
+
|
37 |
+
outputs = model.generate(**inputs, max_new_tokens=500)
|
38 |
+
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
39 |
+
```
|
40 |
+
|
41 |
+
|
42 |
+
## Model Details
|
43 |
+
|
44 |
+
(Describe the model's architecture, focusing on its mixture of experts design.)
|
45 |
+
|
46 |
+
## Dataset
|
47 |
+
|
48 |
+
(Details about the BiMed1.3M dataset, including composition and access.)
|
49 |
+
|
50 |
+
## Benchmarks and Performance
|
51 |
+
|
52 |
+
(Details about benchmarks and results.)
|
53 |
+
|
54 |
+
## Limitations and Ethical Considerations
|
55 |
+
|
56 |
+
Users are urged to employ BiMediX responsibly, especially when applying its outputs in real-world medical scenarios.
|
57 |
+
It is imperative to verify the model's advice with qualified healthcare professionals and not to rely on AI for medical diagnoses or treatment decisions.
|
58 |
+
Despite the overall advancements BiMediX brings to the field of medical NLP, it shares common challenges with other language models,
|
59 |
+
including hallucinations, toxicity, and stereotypes.
|
60 |
+
|
61 |
+
### Recognized Limitations
|
62 |
+
|
63 |
+
- **Hallucinations**: BiMediX, like many advanced LLMs, can sometimes generate information that, while plausible, may not be factually accurate or relevant to the given context.
|
64 |
+
- **Toxicity and Stereotypes**: The model may inadvertently propagate stereotypes or produce responses that could be considered toxic, reflecting biases present in the training data.
|
65 |
+
- **Accuracy of Medical Diagnoses**: While we have conducted both automatic and qualitative evaluations with medical professionals, we must acknowledge that BiMediX's medical diagnoses and recommendations are not infallible. Users should treat the model's output as informational rather than definitive medical advice.
|
66 |
+
|
67 |
+
We are committed to continuous improvement and ethical AI research, and we look forward to collaborating with the community to address these challenges.
|
68 |
+
|
69 |
+
## License and Citation
|
70 |
+
|
71 |
+
BiMediX is released under the Apache License 2.0.
|
72 |
+
For more details, please refer to the [LICENSE](LICENSE) file included in this repository.
|
73 |
+
|
74 |
+
If you use BiMediX in your research, please cite our work as follows:
|
75 |
+
|
76 |
+
```bibtex
|
77 |
+
@article{yourModel2024,
|
78 |
+
title={BiMediX: Bilingual Medical Mixture of Experts LLM},
|
79 |
+
author={Your Name and Collaborators},
|
80 |
+
journal={Journal of AI Research},
|
81 |
+
year={2024},
|
82 |
+
volume={xx},
|
83 |
+
number={xx},
|
84 |
+
pages={xx-xx},
|
85 |
+
doi={xx.xxxx/xxxxxx}
|
86 |
+
}
|
87 |
+
```
|
88 |
+
|
89 |
+
|
90 |
+
Visit our [GitHub](#) for more information and resources.
|