'Do I need to be here?': Some New Yorkers decide to pack up and leave