Text this: When Does Model-Based Control Pay Off?