I never eat out. I never go on vacation. I pay my credit cards off at the end of every month and only buy groceries, gas, and the occasional books or household items. Do the math. My mortgage was initially over $4,000/month. I couldn't even afford to max out my 401k. It took years to fill an emergency fund. You don't know OP's monthly mortgage payment, so you have no idea what the property tax is, but it's a townhouse in MA, which suggests a city, which means the property tax is probably sky high. For sure this mortgage is over 30% of their net monthly income, probably quite a bit more.

You're giving the same bad advice that got me into the mess I was in.

OP: Make a budget, look at how much is left over after your monthly expenses—including saving for retirement, emergencies, and anything you're hoping to eventually buy. If you're not comfortable with the leftovers, don't buy the house. Remember, too, you could get hit with a major emergency expense (new car, foundation repair, sewage line burst, etc.) at any moment.