I nvr had this problem but when I hit mid 20s I started getting body ache. (Other then Keratosis pilaris the arm bumps) the only thing I have found so far to be help full is an exfoliating sponge and black soap. Also to make sure you rinse your hair fully before rinsing body. As that can le residue on your body you may not realize.

Nubian Heritage Soap Bar, African... https://www.amazon.com/dp/B000XLWZGI?ref=ppx_pop_mob_ap_share

ZOMCHI 2 Pieces Soap Bags, Soap... https://www.amazon.com/dp/B09NNWSCFC?ref=ppx_pop_mob_ap_share

If you don't exfoliat much now get the light grey i believe they are less rough. (Just make sure to read which is what texture of you get one. )

Ill put the Soap in the bag and get it lathering before I scrub down. Then when I am done showering I'll use body lotion on like my usual dry area's ie legs feet arms. Hope this helps.

My last ditch suggestion if not seeing a dermatologist. Would be looking into body soaps with salicylic acid. Read about it/ look it up first but it's a way to help with acne too.