Stateful models for single GPU. https://docs.openvino.ai/2024/openvino-workflow/running-inference/stateful-models.html