Being called ‘woke’ is an insult to everyone – except if you vote Labour