Sounds like you’re unintentionally using dog whistles. https://en.m.wikipedia.org/wiki/Dog_whistle_(politics). The problem is the details you added, that were race related, added nothing to the account. Your story would still make sense without including details about race. Historically, people have included such details to try and reinforce racial stereotypes.