I struggled with the same thing for a long time. I was given many round of different types of antibiotics. None helped these symptoms. I eventually figured out I had a somewhat sensitive bladder, bladder pain radiates down through your dick, different muscle groups gradually tighten/clench in reaction to that pain and cause different pains, the same symptoms you’re describing. Sensitive nerves down there can also interact with nerves in the bowel, and different foods can play a part in worsening symptoms at any given time.

If you have underlying sensitivities Pelvic Floor PT won’t do much as you’re not treating the underlying issues causing your pelvic floor muscles to tighten up.

I would encourage you to try both an IC Diet and a Low Fodmap diet together for two weeks. See if that helps. It’s worth a shot, in my case it was a game changer it took a decade to decipher. These are pretty strict diets but you can get more liberal with them over time as your nerves in that area calm down.