European leaders fail to grasp 'hardening' of UK view on Brexit, Latvia warns