For a question answering task, you would use the [DistilBertForQuestionAnswering] model head.