Update README.md

README.md

@@ -7,70 +7,41 @@ datasets:
 ---
 # BioMedGPT-LM-7B
 
-In this repo, we present a medical language model named BioMedGPT-LM which is the first commercial-friendly GPT model in the biomedical domain and has demonstrated
-superior performance over existing LLMs of the same parameter size. We are releasing a 7B model **BioMedGPT-LM-7B** which is LLaMA2-7b-chat finetuned on the PMC abstracts and papers from the S2ORC.
-
-
-
+**BioMedGPT-LM-7B** is the first large generative language model based on Llama2 in the biomedical domain.
+It was fine-tuned from the Llama2-7B-Chat with millions of biomedical papers from the [S2ORC corpus](https://github.com/allenai/s2orc/blob/master/README.md). Through further fine-tuning, BioMedGPT-LM-7B outperforms or is on par with human and significantly larger general-purpose foundation models on several biomedical QA benchmarks.
 
 ### Training Details
 
-
-
 The model was trained with the following hyperparameters:
 
-* Epochs: 5 
-* Batch size: 192 
-* Cutoff length: 2048
+* Epochs: 5
+* Batch size: 192
+* Context length: 2048
 * Learning rate: 2e-5
 
-Overview BioMedGPT-LM-7B was finetuned on over 26 billion tokens highly pertinent to the field of biomedicine. The fine-tuning data are extracted from 5.5 million biomedical papers in S2ORC data using PubMed Central
-(PMC)-ID and PubMed ID as criteria.
+BioMedGPT-LM-7B is finetuned on over 26 billion tokens highly pertinent to the field of biomedicine. The fine-tuning data are extracted from 5.5 million biomedical papers in S2ORC data using PubMed Central (PMC)-ID and PubMed ID as criteria.
 
+### Model Developers
 
-### Model Developers 
 PharMolix  
 
 ### How to Use
-BioMedGPT-LM-7B is a part of **[BioMedGPT-10B](https://github.com/BioFM/OpenBioMed)**, an open-source version of BioMedGPT. BioMedGPT is a multimodal generative pre-trained transformer (GPT) for biomedicine, which bridges the natural language modality and diverse biomed-
-ical data modalities via a single GPT model. BioMedGPT aligns different biological modalities with the text modality via BioMedGPT-LM. The details of BioMedGPT-10B and BioMedGPT-LM-7B can be found in the [technical report]().
-![The architecture of BioMedGPT-10B](BioMedGPT-10B.jpeg)
-
-
-
 
-**Intended Use Cases**
+BioMedGPT-LM-7B is the generative language model of **[BioMedGPT-10B](https://github.com/BioFM/OpenBioMed)**, an open-source version of BioMedGPT.
+BioMedGPT is an open multimodal generative pre-trained transformer (GPT) for biomedicine, which bridges the natural language modality and diverse biomedical data modalities via large generative language models.
 
-|      **Method**        | Parameters (B) | Setting   | MedMCQA(\%) | PubMedQA(\%) |
-|------------------------|----------------|-----------|-------------|--------------| 
-| Human (pass)*          |        -       |  Manual   | -           | 60.0         | 
-| Human (expert)*        |        -       |  Manual   | 90          | 78.0         | 
-|------------------------|----------------|-----------|-------------|--------------|
-| InstructGPT*           | 175            | zero-shot | 44.0        | 73.2         | 
-| ChatGPT*               | -              | zero-shot | 44.7        | 63.9         | 
-| Llama*                 | 7              | zero-shot | 24.3        | 5.2          | 
-| Llama2                 | 7              | zero-shot | 30.6        | 3.7          | 
-| Llama2-Chat            | 7              | zero-shot | 35.5        | 21.9         |
-|------------------------|----------------| --------- |-------------|--------------|
-| Llama                  | 7              |Fine-tuing | 48.2        | 73.4         |
-| Llama2-Chat            | 7              |Fine-tuing | 48.3        | 75.5         | 
-| PMC-Llama              | 7              |Fine-tuing | 50.5        | 69.5         | 
-|------------------------|----------------|-----------|-------------|--------------|
-| **BioMedGPT-LM-7B**    | 7              |Fine-tuing | **51.4**    | **76.1**     | 
-
-**Out-of-scope Uses**
+More technical details of BioMedGPT-LM-7B, BioMedGPT-10B, and BioMedGPT can be found in the [technical report](https://pan.baidu.com/s/1iAMBkuoZnNAylhopP5OgEg?pwd=7a6b).
 
+![The architecture of BioMedGPT-10B](BioMedGPT-10B.jpeg)
 
 ### Technical Report
-"BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine"
 
+"BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine"
 
 ### github
-[https://github.com/BioFM/OpenBioMed](https://github.com/BioFM/OpenBioMed)
 
+[https://github.com/BioFM/OpenBioMed](https://github.com/BioFM/OpenBioMed)
 
 ### Limitations
 
-[Highlight any limitations or potential issues of your model.]
-
-
+Large-scale generative language models represent a novel technology, with their generated outputs determined by probabilities, possibly resulting in unforeseen issues, such as generating responses that may contain elements of danger, bias, discrimination, or other harmful content. Up to this point, our experiments focus on data within the field of English biomedical domains, leaving many scenarios unaddressed. Therefore, before using BioMedGPT, developers should conduct safety testing and necessary adjustments. While BioMedGPT has expertise in areas like biomedicine and chemistry, it should not be employed for research that is hazardous or could endanger human life, and it cannot replace medical professionals or provide professional treatment advice. Users need to be cautious and take extra care when using these models.