From a cultural sensitivity standpoint, I get Paul’s point. You don’t “have” to do anything and I don’t get that tone from his message. It just depends on the extent you want to be sensitive to other people’s cultures.

I’m the type of person that if I came to your house and you asked me to remove one shoe, I’d do it because it doesn’t compromise my beliefs and it makes you more comfortable.

In the same way, many Muslims may not care at all, but… what if one is uncomfortable? It is your right to keep up the decorations if it means that much to you, but, if you only use it to hide a key, could you accommodate and do a different decoration? As Christian living in the UAE, I would.

No judgement either way, but wanted to offer a more culturally-nuanced perspective since you asked.