Decision on holding delayed Olympic Games 'could go either way', says Japan minister