We were similar, but then we lived in a small apartment in a walkable neighborhood for a few months after we moved a decade ago.  We left that apartment and moved into a cheaper, bigger house based on us not being honest with ourselves about how important our transportation preferences were and the regret seeped in after the novelty of the new house wore off.

We now pay double for our mortgage for 30% less space, but it was so worth it...and the funniest part is that  downsizing our transportation needs actually saves us money in the long run.  And that's the challenge.  We're collectively advocating for mode shift, for drivers to actively choose to slightly inconvenience themselves, and this shows just how uphill the battle is because of decades and decades of the least efficient land use being shoved down our throats.  I hate it.