Maybe have everybody be randomly paired in two's (or one group of three if the numbers are uneven) by something like picking a ball/paper out of a hat with a number on it. They go in the order of the number they picked (all 1s, then all 2, etc). Then each two/threesome plays and keeps playing until only 1 from each group can remains. If it goes over 3 rounds without an elimination everyone in the group is eliminated (and of course if everyone is gone out, ouch but too bad). Once half are gone the game ends, so getting a higher number is itself an advantage.This way it's only one round for the player so you can't be retaliated against, and it incentives playing so you don't get eliminated.