|
--- |
|
license: mit |
|
widget: |
|
- src: >- |
|
https://prod-images-static.radiopaedia.org/images/566180/d527ff6fc1482161c9225345c4ab42_big_gallery.jpg |
|
candidate_labels: enlarged heart, pleural effusion |
|
example_title: X-ray of cardiomegaly |
|
library_name: open_clip |
|
pipeline_tag: zero-shot-image-classification |
|
--- |
|
|
|
# Model Card for WhyXrayClip |
|
|
|
# Table of Contents |
|
|
|
1. [Model Details](#model-details) |
|
2. [Get Started](#how-to-get-started-with-the-model) |
|
3. [Uses](#uses) |
|
4. [Training Details](#training-details) |
|
5. [Evaluation](#evaluation) |
|
6. [Citation](#citation) |
|
|
|
## Model Details |
|
|
|
- **Model:** WhyXrayClip |
|
|
|
<!-- Provide the basic links for the model. --> |
|
|
|
- **Paper:** https://arxiv.org/pdf/2405.14839 |
|
- **Website:** https://yueyang1996.github.io/knobo/ |
|
- **Repository:** https://github.com/YueYANG1996/KnoBo |
|
|
|
|
|
## How to Get Started with the Model |
|
|
|
Use the code below to get started with the model. |
|
|
|
[More Information Needed] |
|
|
|
|
|
## Uses |
|
|
|
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. --> |
|
|
|
### Direct Use |
|
|
|
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. --> |
|
|
|
[More Information Needed] |
|
|
|
### Downstream Use |
|
|
|
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app --> |
|
|
|
[More Information Needed] |
|
|
|
### Out-of-Scope Use |
|
|
|
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. --> |
|
|
|
[More Information Needed] |
|
|
|
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations. |
|
|
|
|
|
## Training Details |
|
|
|
### Training Data |
|
|
|
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. --> |
|
|
|
[More Information Needed] |
|
|
|
### Preprocessing [optional] |
|
|
|
[More Information Needed] |
|
|
|
|
|
### Training Hyperparameters |
|
|
|
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision --> |
|
|
|
## Evaluation |
|
|
|
<!-- This section describes the evaluation protocols and provides the results. --> |
|
|
|
### Testing Data |
|
|
|
<!-- This should link to a Dataset Card if possible. --> |
|
|
|
[More Information Needed] |
|
|
|
|
|
### Metrics |
|
|
|
<!-- These are the evaluation metrics being used, ideally with a description of why. --> |
|
|
|
[More Information Needed] |
|
|
|
### Results |
|
|
|
[More Information Needed] |
|
|
|
|
|
## Citation |
|
|
|
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. --> |
|
|
|
**BibTeX:** |
|
|
|
``` |
|
@article{yang2024textbook, |
|
title={A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis}, |
|
author={Yue Yang and Mona Gandhi and Yufei Wang and Yifan Wu and Michael S. Yao and Chris Callison-Burch and James C. Gee and Mark Yatskar}, |
|
journal={arXiv preprint arXiv:2405.14839}, |
|
year={2024} |
|
} |
|
``` |
