Google Cloud documentation

Available DLCs on Google Cloud

Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

Available DLCs on Google Cloud

Below you can find a listing of all the Deep Learning Containers (DLCs) available on Google Cloud.

The listing below only contains the latest version of each one of the Hugging Face DLCs, the full listing of the available published containers in Google Cloud can be found either in the Google Cloud Deep Learning Containers Documentation, in the Google Cloud Artifact Registry or via the gcloud container images list --repository="us-docker.pkg.dev/deeplearning-platform-release/gcr.io" | grep "huggingface-" command.

Text Generation Inference (TGI)

Container URI Path Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-generation-inference-cu124.2-3.ubuntu2204.py311 text-generation-inference-gpu.2.3.1 GPU

Text Embeddings Inference (TEI)

Container URI Path Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cu122.1-4.ubuntu2204 text-embeddings-inference-gpu.1.4.0 GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-text-embeddings-inference-cpu.1-4 text-embeddings-inference-cpu.1.4.0 CPU

PyTorch Inference

Container URI Path Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cu121.2-2.transformers.4-44.ubuntu2204.py311 huggingface-pytorch-inference-gpu.2.2.2.transformers.4.44.0.py311 GPU
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-inference-cpu.2-2.transformers.4-44.ubuntu2204.py311 huggingface-pytorch-inference-cpu.2.2.2.transformers.4.44.0.py311 CPU

PyTorch Training

Container URI Path Accelerator
us-docker.pkg.dev/deeplearning-platform-release/gcr.io/huggingface-pytorch-training-cu121.2-3.transformers.4-42.ubuntu2204.py310 huggingface-pytorch-training-gpu.2.3.0.transformers.4.42.3.py310 GPU
< > Update on GitHub