autoevaluator's picture
Add evaluation results on the ncbi_disease config and test split of chintagunta85/ncbi_disease
5f468a5
|
raw
history blame
2.84 kB
metadata
language: en
license: apache-2.0
tags:
  - token-classification
  - NER
  - Biomedical
  - Diseases
datasets:
  - BC5CDR-diseases
  - ncbi_disease
  - tner/bc5cdr
  - commanderstrife/jnlpba
  - bc2gm_corpus
  - drAbreu/bc4chemd_ner
  - linnaeus
  - chintagunta85/ncbi_disease
model-index:
  - name: sschet/biobert_diseases_ner
    results:
      - task:
          type: token-classification
          name: Token Classification
        dataset:
          name: chintagunta85/ncbi_disease
          type: chintagunta85/ncbi_disease
          config: ncbi_disease
          split: test
        metrics:
          - type: accuracy
            value: 0.9362988033361538
            name: Accuracy
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYTBiNDAwM2IyNWM0ZWNmYTdhYWQyNjk3NDMwOWFjMTQxMWNhMWNmODg5MzZjYTU3MmMwYmIxMzMyYzUzNDAyNiIsInZlcnNpb24iOjF9.VTE-MmXn0pX191rcV8r68Z-AYMTR_Ev9uPJulj-PALo1McjtYE1z1Abtdrfscm83vyhR_w-GzsOb6MuG-B0xDA
          - type: precision
            value: 0.25534079348931843
            name: Precision
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGNmMjU1YTdmNzRiM2MwN2I3YTQwNTk4MmI0YTIxYWU1ODViYjZjYzNlZTFlY2JhMjFhOTNmZjY4NWU3OTUxMiIsInZlcnNpb24iOjF9.m0Vz_BGjosNn76cQ-LgwqdhW60KqBulejuqyFuLwZd8Ier7ywLKgURQUq9PxtXDqS4d6Cbj27UWQ-RSBEEMyAg
          - type: recall
            value: 0.11028119507908611
            name: Recall
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOGNlZWRmYmU0YzY3YzdiYWIzYTZlNjMzOWFkNTk4ZDY2MzU0YjJjMzUxYTFlYzk5YzRjZGJiZTE1ZDhhYmY4YiIsInZlcnNpb24iOjF9.9KinjhfqlNydC4C-cuD_1mFLb8pwi82lsTaR2YMSh0vQy2Jt0dEoU3mFbOA3qctnZlGGvvRTZqJvvql6HCijAw
          - type: auc
            value: NaN
            name: AUC
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMjQ2ODllNGQzYjgyZmI2NGJmMmE2YWIxYWQxMzQwYmFhNDk5OWU2ZDEyYWM1NjQzMjhhY2NiYTU5MmM0YzU4MSIsInZlcnNpb24iOjF9.TcteHvWWulEQQLDgPlEM3BHq4i_75_is6MtVAxsLS_hz2QlWa9-mIN90KOztp-ismHkH1ciQmS46bdq-fn7cBQ
          - type: f1
            value: 0.15403498005523167
            name: F1
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYjc5ZTkwYWM2MzNlZjFmOWJkZTFhYWFkODQ0NDM1NGRiMzRlYjYwODExM2I0ZWU4MDZjYTUzOWIyMThhM2U0MiIsInZlcnNpb24iOjF9._Hr1AWhj7EHAEZPn0kn-BmJuMVVAUnUipwbGDtUre7n2wNiJmv0oRcsMOx1AtdQ9WXAY0KAYtmWYUyPHyJPpDg
          - type: loss
            value: 0.5614550113677979
            name: loss
            verified: true
            verifyToken: >-
              eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZTVlYmJhYTMzMDg5ZWIxYzA2NmM3YjA4MGYwNzg2OWEyMzNiZTRjYzdmZjAyMzAyMDE1MTc5YjcwMTBiMzBhZSIsInZlcnNpb24iOjF9.XMC2Nvx-qyfGddHCXWRk2l4CuAjjUCBtmSd_Eg6r1OFcmXCSfrM4oJ3JksZ2APNawrtNqfflDdja0uQJCXI_BA

BioBERT model fine-tuned in NER task with BC5CDR-diseases and NCBI-diseases corpus

This was fine-tuned in order to use it in a BioNER/BioNEN system which is available at: https://github.com/librairy/bio-ner