You're not imagining it, May really has been chillier than average