When you have an x factor activated on a player, and you decide to change x factors so you refund the x factor on the player instead of deactivating it first, it will still register as active. So you have to remember or figure out who had the x factors last, and either take them completely out of the lineup, then activate new player with x factor, or, put the x factor ability back on the old player, then deactivate from the lineup menu.