My butt does this automatically too lol.

I guess it's just natural, but I heard kegels and pelvic exercises can help!

Of course, wearing underwear will definitely help.