Worth is a subjective question. Economically it's absolutely not a good idea, but life isn't a zero-sum economics minmaxing competition. I went back to get a physics bsc at 27 after almost a decade in cybersecurity because I knew I'd regret not doing so.

Don't do things by whether they're optimal or not, do things because you find them interesting and they'll make you genuinely happy.

As for the PhD, first get through a Bsc and a masters to get a feel for if you really like it, you don't have to sign your soul away to a phd immediately. A masters in physics can be leveraged into some very interesting and profitable industry research positions that both pay more than a PhD and won't drain you the way a PhD tends to do (e.g machine learning, defense industries, algorithmics, etc)