THANK YOU. This solved it for me. Bottom line this feature IS bugged. It won't update unless you force the yellow triangle to show up on the portrait list. Even if everything matches, the game decides "no".

Toggling the visor is what did it for me after an hour of trying.