In other words, the size of the output sequence, not
including the tokens in the prompt.