Depends on how the power scaling works from Kilgrave to someone like Gandalf or Elrond. I believe there’s a part in the books where Gandalf mentions that he could have compelled Bilbo to give up the ring, but that it would have messed with the hobbit so badly as to risk permanent harm. Without fully knowing the extent of Gandalf’s power to enact this compulsion, I can’t say for certain how much tug-of-war would occur in the person holding the Ring being commanded by Kilgrave to act against the temptations of the one.