HuggingSara commited on
Commit
44ec408
·
verified ·
1 Parent(s): 5de3d93

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +83 -3
README.md CHANGED
@@ -2,9 +2,89 @@
2
  title: README
3
  emoji: 🏢
4
  colorFrom: indigo
5
- colorTo: pink
6
  sdk: static
7
- pinned: false
 
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  title: README
3
  emoji: 🏢
4
  colorFrom: indigo
5
+ colorTo: blue
6
  sdk: static
7
+ pinned: true
8
+ license: apache-2.0
9
  ---
10
 
11
+ # BiMediX: Bilingual Medical Mixture of Experts LLM
12
+
13
+ Welcome to the official HuggingFace repository for BiMediX, the bilingual medical Large Language Model (LLM) designed for English and Arabic interactions. BiMediX facilitates a broad range of medical interactions, including multi-turn chats, multiple-choice Q&A, and open-ended question answering.
14
+
15
+ ## Key Features
16
+
17
+ - **Bilingual Support**: Seamless interaction in both English and Arabic for a wide range of medical interactions, including multi-turn chats, multiple-choice question answering, and open-ended question answering.
18
+ - **BiMed1.3M Dataset**: Unique dataset with 1.3 million bilingual medical interactions across English and Arabic, including 250k synthesized multi-turn doctor-patient chats for instruction tuning.
19
+ - **High-Quality Translation** : Utilizes a semi-automated English-to-Arabic translation pipeline with human refinement to ensure accuracy and quality in translations.
20
+ - **Evaluation Benchmark for Arabic Medical LLMs**: Comprehensive benchmark for evaluating Arabic medical language models, setting a new standard in the field.
21
+ - **State-of-the-Art Performance**: Significantly outperforms existing models in medical benchmarks, while 8-times faster than existing models.
22
+
23
+
24
+ ## Getting Started
25
+
26
+ ```python
27
+ from transformers import AutoModelForCausalLM, AutoTokenizer
28
+
29
+ model_id = "TODO"
30
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
31
+
32
+ model = AutoModelForCausalLM.from_pretrained(model_id)
33
+
34
+ text = "TODO"
35
+ inputs = tokenizer(text, return_tensors="pt")
36
+
37
+ outputs = model.generate(**inputs, max_new_tokens=500)
38
+ print(tokenizer.decode(outputs[0], skip_special_tokens=True))
39
+ ```
40
+
41
+
42
+ ## Model Details
43
+
44
+ (Describe the model's architecture, focusing on its mixture of experts design.)
45
+
46
+ ## Dataset
47
+
48
+ (Details about the BiMed1.3M dataset, including composition and access.)
49
+
50
+ ## Benchmarks and Performance
51
+
52
+ (Details about benchmarks and results.)
53
+
54
+ ## Limitations and Ethical Considerations
55
+
56
+ Users are urged to employ BiMediX responsibly, especially when applying its outputs in real-world medical scenarios.
57
+ It is imperative to verify the model's advice with qualified healthcare professionals and not to rely on AI for medical diagnoses or treatment decisions.
58
+ Despite the overall advancements BiMediX brings to the field of medical NLP, it shares common challenges with other language models,
59
+ including hallucinations, toxicity, and stereotypes.
60
+
61
+ ### Recognized Limitations
62
+
63
+ - **Hallucinations**: BiMediX, like many advanced LLMs, can sometimes generate information that, while plausible, may not be factually accurate or relevant to the given context.
64
+ - **Toxicity and Stereotypes**: The model may inadvertently propagate stereotypes or produce responses that could be considered toxic, reflecting biases present in the training data.
65
+ - **Accuracy of Medical Diagnoses**: While we have conducted both automatic and qualitative evaluations with medical professionals, we must acknowledge that BiMediX's medical diagnoses and recommendations are not infallible. Users should treat the model's output as informational rather than definitive medical advice.
66
+
67
+ We are committed to continuous improvement and ethical AI research, and we look forward to collaborating with the community to address these challenges.
68
+
69
+ ## License and Citation
70
+
71
+ BiMediX is released under the Apache License 2.0.
72
+ For more details, please refer to the [LICENSE](LICENSE) file included in this repository.
73
+
74
+ If you use BiMediX in your research, please cite our work as follows:
75
+
76
+ ```bibtex
77
+ @article{yourModel2024,
78
+ title={BiMediX: Bilingual Medical Mixture of Experts LLM},
79
+ author={Your Name and Collaborators},
80
+ journal={Journal of AI Research},
81
+ year={2024},
82
+ volume={xx},
83
+ number={xx},
84
+ pages={xx-xx},
85
+ doi={xx.xxxx/xxxxxx}
86
+ }
87
+ ```
88
+
89
+
90
+ Visit our [GitHub](#) for more information and resources.