Text Classification
Transformers
PyTorch
ONNX
Safetensors
English
deberta
Trained with AutoTrain
Inference Endpoints

Launching this into production

#3
by anujn - opened

Firstly thank you for this awesome classifier.

I would like to launch it to a dedicated endpoint. Is it currently hosted on GPU or CPU.
Also how can we return the multi-label classification's.

We have tried using HF's deploy method on GPU.
It's quick but only wants to return a single classification.

Any guidence here would be much appreciated.

anujn changed discussion status to closed

Sorry figured it out:
"return_all_scores": True

Koala AI org

Glad you got it sorted! :)

Sign up or log in to comment