Batch size
By default, pipelines will not batch inference for reasons explained in detail here.