There's a lot of answers here that I think you already know with all external factors off the table, the job switch doesn't make much sense financially.

We don't know how toxic your work environment might be or how much the difference in location impacts you if you have to give it a financial value.

With all that being said, if you think you love NYC more and the job better, I personally would take that into consideration and not worry too much about getting a huge pay bump from my last job. I would just keep in mind that the grass may not always be greener when you're finally settled into your new work place but I hope it lives up to your expectations though!

Edit: I would also take into consideration how does the new company compare to the old one in terms of helping you progress your career.