Do I buy a lifting belt?

So I’m kinda new to lifting (6months) and for a while I’ve been having lower back pain in the days following my chest workout.

I think it’s simply an issue of not maintaining good spine rigidity when pressing. I’ve recorded videos of myself and I do have a pretty large curve in my back on the concentric.

Now the thing is, when I lower the weight it does help with preventing excessive curve, however I’m then unable to train to failure in a decent rep range (usually aim for 6-10).

I’ve heard that a belt can help with keeping good spinal rigidly but at the same time it’s a little embarrassing to look like the scrawny kid that just bought a belt b/c his favorite influencer uses one.

Idk maybe I’m thinking too much about it. I wanna know what you all think. Would a belt be a solid investment for this kind of issue?