This tensor should be the same size as input_ids.