Impending earthquakes along fault lines can cause that kind of noise days or even months before the actual earthquake itself. These have been heard all over the world, the sound doesn't seem to have a locus but seem like it comes from everywhere. It's really deep underground and can't be pinpointed. I understand that much of NYC is on top of bedrock, so it may be that the deep earth below NYC is shifting and might end with an earthquake.