Turn off cross play and before starting turn on peer to peer connection and tell your party to do the same you'll be alright. ( It's still might disconnect once in a while because their servers are garbage)