At a tilt of 90°, the equator would still have overhead sun on the equinoxes, but it would last much shorter than overhead sun on the poles and won't be accompanied by long days.
annual solar radiation at different latitudes and tilts. x-axis is latitude. Each line is a different tilt.
Of course, higher the tilt, bigger the annual seasonal cycle. But the poles get so much sun, it'd take a while to cool down. I'd imagine if the poles were most ocean, it'd never get cold there. Tropics would get warm air from north or south depending on season.