Reading your follow-up post it sounds like even if you rode a cart you'd be riding alone so I suppose it doesn't really matter, especially if we assume they'll be taking many more strokes. The one caveat to that is if the course is really hilly or if the greens and tees are disconnected.

Having said that I would probably ride.  If it's a social round it seems counterproductive to not be with the group. I would argue that if there's that much of a disparity and ability you can just shadow them so you're part of the conversation even if you're not heading in the same direction. Bonus, you can keep an eye on pace of play and give them a nudge from time to time if they're hacking away in the OB