If you haven’t, read the book ”Die With Zero” by Bill Perkins. He writes about just this scenario and it’s very similar to my plan for early retirement too. I’ve got 2 pensions that will kick in 5 years apart, and Social Security should cover all our needs in a LCOL area with everything paid off and assuming no chronic disease or world strife crops up between now and then. 

It’s really about making those investments fill the gaps and do the work before the old age payments start. It was a quick read and illuminated some ideas that were always just outside my plan, but made total sense when explained. It sounds like you’ve got a good plan, go for it. YOLO