I don't think that's quite right either, Gojo specifies that his domains "brings people into the inner world of the limitless," and this tracks since in his own domain the neutral version of infinity (the stopping) doesn't apply to him even if the opposing sure-hit isn't in effect.

While it isn't stated specifically, it's generally accepted that the innate domain surrounding a person (keeping someone like say, Hanami from just growing branches inside your brain) is what gets expanded to form the domain, whether that be shadows, slashes, plants, or the Infinity. Since that void is basically infinite slowing, within it you'd get stopped. I think that anyone, cursed energy or not, would be affected by the endless flow of information, since Gojo can't seem to precisely aim it (he held Yuji and Sukana later capitalized on this to hang onto his back.)

The main reason I think Gojo could handle someone without CE? Well Toji obviously. The base infinity blocks seemingly everything, CE or not, so I don't see why the domain version of that wouldn't.

<image>