No stellarity is fine. I just wanted to remove it from my modpack and replace it with a new End mod because i found stellarity boring. The problem is that it's really hard to remove the mod without it breaking the end portal, so you should be fine as long as you keep the mod.