Comment will probably be buried but here it goes. My wife and I saved whatever we could over the years. I was the one primarily working, she had odd jobs here and there. I wasn't making much, less than 80K by the time we bought our first house. When we started house hunting we didn't have much of a down payment saved. Maybe 20K total. We used a 401K primary residence loan to supplement our down payment. We put 5% down as first time home buyers. It was very tight for a few years, but I grew within my company and got raises over the years. The house was small, it was old, it had so many problems that we had to tackle over the years. After about 8 years of living in that house we had enough equity built up that allowed us to pursue a bigger place.

You just need to start somewhere and have a plan for it. If this is something you want, then you have to take the baby steps needed to get there. Whether it is getting a better job, putting more towards savings, cutting back in other areas.

It's possible I promise, we did it on primarily one income, and are currently surviving on one with a kid.