Text this: Generation Probabilities Are Not Enough