seanfarrell commited on
Commit
b3a806e
·
verified ·
1 Parent(s): 4d3d187

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -26,6 +26,12 @@ base_model:
26
 
27
  PetBERT-ICD is a multi label classification model based on the [PetBERT](huggingface.co/savsnet/petbert) architecture further trained on over 500 million additional words from first-opinion veterinary clinicians from across the UK. PetBERT-ICD was trained on a multi-label dataset of the 20 'chapters' of the International Classification of Disease (ICD)
28
 
 
 
 
 
 
 
29
  ## Paper Abstract
30
  Effective public health surveillance requires consistent monitoring of disease signals such that researchers and decision-makers can react dynamically to changes in disease occurrence. However, whilst surveillance initiatives exist in production animal veterinary medicine, comparable frameworks for companion animals are lacking. First-opinion veterinary electronic health records (EHRs) have the potential to reveal disease signals and often represent the initial reporting of clinical syndromes in animals presenting for medical attention, highlighting their possible significance in early disease detection. Yet despite their availability, there are limitations surrounding their free text-based nature, inhibiting the ability for national-level mortality and morbidity statistics to occur. This paper presents PetBERT, a large language model trained on over 500 million words from 5.1 million EHRs across the UK. PetBERT-ICD is the additional training of PetBERT as a multi-label classifier for the automated coding of veterinary clinical EHRs with the International Classification of Disease 11 framework, achieving F1 scores exceeding 83% across 20 disease codings with minimal annotations. PetBERT-ICD effectively identifies disease outbreaks, outperforming current clinician-assigned point-of-care labelling strategies up to 3 weeks earlier. The potential for PetBERT-ICD to enhance disease surveillance in veterinary medicine represents a promising avenue for advancing animal health and improving public health outcomes.
31
 
@@ -35,11 +41,6 @@ Effective public health surveillance requires consistent monitoring of disease s
35
  - **License:** openrail
36
  - **Finetuned from model [optional]:** [bert-base-uncased](https://huggingface.co/bert-base-uncased)
37
 
38
- ### Model Sources
39
-
40
- - **Repository:** https://github.com/SAVSNET/PetBERT
41
- - **Paper:** https://www.nature.com/articles/s41598-023-45155-7
42
-
43
 
44
  ## How to Get Started with the Model
45
  ```
 
26
 
27
  PetBERT-ICD is a multi label classification model based on the [PetBERT](huggingface.co/savsnet/petbert) architecture further trained on over 500 million additional words from first-opinion veterinary clinicians from across the UK. PetBERT-ICD was trained on a multi-label dataset of the 20 'chapters' of the International Classification of Disease (ICD)
28
 
29
+ ### Model Sources
30
+
31
+ - **Repository:** https://github.com/SAVSNET/PetBERT
32
+ - **PetBERT Foundation Model** huggingface.co/savsnet/petbert
33
+ - **Paper:** https://www.nature.com/articles/s41598-023-45155-7
34
+
35
  ## Paper Abstract
36
  Effective public health surveillance requires consistent monitoring of disease signals such that researchers and decision-makers can react dynamically to changes in disease occurrence. However, whilst surveillance initiatives exist in production animal veterinary medicine, comparable frameworks for companion animals are lacking. First-opinion veterinary electronic health records (EHRs) have the potential to reveal disease signals and often represent the initial reporting of clinical syndromes in animals presenting for medical attention, highlighting their possible significance in early disease detection. Yet despite their availability, there are limitations surrounding their free text-based nature, inhibiting the ability for national-level mortality and morbidity statistics to occur. This paper presents PetBERT, a large language model trained on over 500 million words from 5.1 million EHRs across the UK. PetBERT-ICD is the additional training of PetBERT as a multi-label classifier for the automated coding of veterinary clinical EHRs with the International Classification of Disease 11 framework, achieving F1 scores exceeding 83% across 20 disease codings with minimal annotations. PetBERT-ICD effectively identifies disease outbreaks, outperforming current clinician-assigned point-of-care labelling strategies up to 3 weeks earlier. The potential for PetBERT-ICD to enhance disease surveillance in veterinary medicine represents a promising avenue for advancing animal health and improving public health outcomes.
37
 
 
41
  - **License:** openrail
42
  - **Finetuned from model [optional]:** [bert-base-uncased](https://huggingface.co/bert-base-uncased)
43
 
 
 
 
 
 
44
 
45
  ## How to Get Started with the Model
46
  ```