Text this: Testing the Interpretability Hypothesis