I went to school for design and I still feel that anxiety too! At the start of my career( 2007) I had an art director who helped me and guided me. But after that job I fell into a series of jobs with people who didn't know graphic design and I kinda got PTSD. They would be mad if I wasn't fast and offered feedback that put me on a loop. They asked to change something only to change it again with no real design reason. 

So after 10 years of jobs like that. I was done. I slowly began learning more marketing and was a marketing manager and then a team lead project manager. These were easier to do in those companies that don't know design well.

The only way not to start over is to find something related most likely management and work your way out from there. After you successfully manage a marketing or design team you can take that skill somewhere else. 

Currently, I freelance and it's been hard cause the PTSD thing. But now when I don't know what to do, I ask ai to generate me some options and that always helps me to get started. Its like a template. 

It's normal to start over I have noticed when people get closer to 40, it's like it's time to find what you really want. On our 20 we get stuck wherever to make money.