autoevaluator
HF staff
Add evaluation results on the default config and validation split of acronym_identification
9441c5a
language: en | |
tags: | |
- autotrain | |
datasets: | |
- lewtun/autotrain-data-acronym-identification | |
- acronym_identification | |
widget: | |
- text: I love AutoTrain 🤗 | |
co2_eq_emissions: 10.435358044493652 | |
model-index: | |
- name: autotrain-demo | |
results: | |
- task: | |
type: token-classification | |
name: Token Classification | |
dataset: | |
name: acronym_identification | |
type: acronym_identification | |
args: default | |
metrics: | |
- type: accuracy | |
value: 0.9708090976211485 | |
name: Accuracy | |
- task: | |
type: token-classification | |
name: Token Classification | |
dataset: | |
name: acronym_identification | |
type: acronym_identification | |
config: default | |
split: train | |
metrics: | |
- type: accuracy | |
value: 0.9790777669399117 | |
name: Accuracy | |
verified: true | |
- type: precision | |
value: 0.9197835301644851 | |
name: Precision | |
verified: true | |
- type: recall | |
value: 0.946479027789208 | |
name: Recall | |
verified: true | |
- type: f1 | |
value: 0.9329403493591477 | |
name: F1 | |
verified: true | |
- type: loss | |
value: 0.06360606849193573 | |
name: loss | |
verified: true | |
- task: | |
type: token-classification | |
name: Token Classification | |
dataset: | |
name: acronym_identification | |
type: acronym_identification | |
config: default | |
split: validation | |
metrics: | |
- type: accuracy | |
value: 0.9758059763069488 | |
name: Accuracy | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTE2M2JlMDBhNDVlMDNmMmUxYTllYTM3MTQyYWIyYmI4OWM4MWM2MDYzNWI5ZTY4YmE4ZTYxODYzNGY4ZTU4NSIsInZlcnNpb24iOjF9.lplj1GdLZOa7EQq_-eDkWMOndxM7I3JMInAPS8Lh1ym-6NZFe8HAVtPtw6uYE1kw3bYSFLiJeDhu17qr4W0LCQ | |
- type: precision | |
value: 0.9339528708927979 | |
name: Precision | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYThjZDI5MTJjZDhmMzgxYmRlYmMxNjRhZTgyM2JkNmVjYWJiZmEyOTIxZDIzNTA0NWFiMmI0YjA0OWUwMmIzNyIsInZlcnNpb24iOjF9.ZGHY1xycw3oPLCswGga9vkSb-EIXjyf-euFLqPYh96B1N6LGRymo-r85cEwTp1Kr-uR6qVeUMrX2mmwL7O2wAw | |
- type: recall | |
value: 0.9157175398633257 | |
name: Recall | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjk5Mzk3MzRlYjg2ZWNmOTZlN2QwZjQ2Y2ZlNzU2NzljODU1NmRmNWVjMmIxODdhZTE4NmQwYTNkY2E2MGZlZSIsInZlcnNpb24iOjF9.JShPPAdznEKVso15qYmJ9OcdiV_W4pE1wrHVZ_A_-bkhboIUATN-rXK2KZmfq1nS3Jxip3qn9GYeFxP9tGU0Dg | |
- type: f1 | |
value: 0.924745317121262 | |
name: F1 | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzlmMDM2ODVmYmEwMDJhZGI5MWI3NjRlNzEwMWYyY2NiMmQ0NjdkZjc2NzFiZmI3Y2VmYWM0MjlmYzFlN2E5NCIsInZlcnNpb24iOjF9.rpqmuMdlxFevTn374B5_eGMlAF79VVGhRIx3ksd2p-2_kHyhRwnjxqs5elQpH_tIHUGSIM49hLqAFi14EKGiAA | |
- type: loss | |
value: 0.07582829147577286 | |
name: loss | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZjYzMDlmNzNiMmRlYmY0ODZhMWM0ZmI3ODJhNDRiM2E1YjczMzBlNDNjM2I2ODBiMzc5NDEzZGIxMjAzMWM2YiIsInZlcnNpb24iOjF9.G7UXqxGnqnfgdze04NsyRsO-SAqNXV81kK7Jp_SYjVP_4gbL0ovV9JDd3hk_h0pWSMVNjgFhI6cwZGXZLsTJBw | |
- type: auc | |
value: NaN | |
name: AUC | |
verified: true | |
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWQyNGFiMDc1ZDgwNGQ5NjFmNzhmZDM4NTYwNzEyYzBhNDQxMzc2ZDczOGJhNWFhMGMwOWE4MTRhNTY3NGQxYiIsInZlcnNpb24iOjF9.WcXce6HBjzSEqOOJoVJU33kF-MjwVZj2a4OWuUd_GIv32NUJVueRWzzHdvUDI_KlPvvvamQJgqN-cCILFaTRAw | |
# Model Trained Using AutoTrain | |
- Problem type: Entity Extraction | |
- Model ID: 7324788 | |
- CO2 Emissions (in grams): 10.435358044493652 | |
## Validation Metrics | |
- Loss: 0.08991389721632004 | |
- Accuracy: 0.9708090976211485 | |
- Precision: 0.8998421675654347 | |
- Recall: 0.9309429854401959 | |
- F1: 0.9151284109149278 | |
## Usage | |
You can use cURL to access this model: | |
``` | |
$ curl -X POST -H "Authorization: Bearer YOUR_API_KEY" -H "Content-Type: application/json" -d '{"inputs": "I love AutoTrain"}' https://api-inference.huggingface.co/models/lewtun/autotrain-acronym-identification-7324788 | |
``` | |
Or Python API: | |
``` | |
from transformers import AutoModelForTokenClassification, AutoTokenizer | |
model = AutoModelForTokenClassification.from_pretrained("lewtun/autotrain-acronym-identification-7324788", use_auth_token=True) | |
tokenizer = AutoTokenizer.from_pretrained("lewtun/autotrain-acronym-identification-7324788", use_auth_token=True) | |
inputs = tokenizer("I love AutoTrain", return_tensors="pt") | |
outputs = model(**inputs) | |
``` |