Text this: Accelerating diagonal methods for bilevel optimization