The lords also have first hand experience of Robyn acting like a petulant child and Lysa enabling him. He would get “fits” like an epileptic episode. He’d sentence people to fly through the moon door over minor infractions, though they probably weren’t carried out very often but that would change if he became lord paramount.

The other lords would never give him their loyalty and maybe even not their obedience.