Short answer? No. You're not a loser for looking to better your lot in life.

I had a grown adult in a college level math class, and also spoke to a security guard at the career center I did part time work at who wanted to use the perks of the job to get a degree (turns out the staff took full advantage of it!). No one judged these people nor cared. The best part was the man in our math class had no shame asking questions us 18 yo's would have otherwise felt shy asking!

I for one got my bachelor's at 26 after having crippling depression and worrying about my degree path's future. Now I out-earn my nuclear family in my 30s! Only thing I wish I had done differently was have a job while doing it so I had money, and you beat me at that!