I'm surprised nobody brought this up, but it really depends on if you're shooting architecture or not. Most people seem to like the "characters" of the city better than the landscape. For that you really need a 70-200 or longer as the last think you want to do is get in someone's face with a camera -- specially there.
From my brief experience in NY the people really don't care if you photograph them but I am not sneaky.

