Text this: Untangling the physical contributions to instantaneous normal mode approximations