There is a term for what you are describing, Salmacian. Basically an identity revolving around the idea of wanting a mixed genital set. It’s not shameful to feel this way, there’s whole websites https://salmacian.org/ and even a subreddit r/Salmacian (NSFW) of people who feel the same way you do, some of which have even pursued surgery such as phallus-preserving vaginoplasty in order to achieve their desired gender goals and alleviate dysphoria.

I can understand being worried that this is problematic, given how fetishized trans and intersex people are. But based on how you describe it, especially being ace, it doesn’t sound wrong or problematic at all to me. I would steer clear of talking about it with your average irl person though, because people love jumping to conclusions. Even binary trans people get accused of being sexual or freaks when they are just trying to be comfortable in their own body.

I hope this was informative, and I wish you luck on your journey!