What are good places to move near NYC with a baby on the way?

I was born upstate and have been to the City a few times, my wife is pregnant and having a baby soon and i love NY and want my son to grow up in or near the city, people that are VERY familiar with NY please give insight on a great place to get a house close or in NYC that has great neighborhoods to grow up in.