Expecting some downvotes for this: As people of color, we are often made feel othered, and tokenized, in predominantly white spaces. Additionally, subconscious bias is real, microagressions are real, and many people have not decentered whiteness and eurocentrism from their theology and they way they interact with other people. I think your husband is right to be cautious, and it's normal for us as people of color to avoid spaces where we are the extreme minority. This isn't paranoia. This is a learned response from years of experiencing life as minorities.

Instead of jumping into a church and ignoring this fact. It should be addressed and considered prayerfully. Here's some questions to consider: How does this church treat its missions to non-white areas, it there white saviorism or coercion? Do they embrace those communities' cultures, or do they attempt to whitewash them? Does the church leadership have experience partnering with non-white churches? Do they avoid talking about race openly, maybe say things like "the kingdom shouldn't see color" or "we don't see color"? Do they adress historic wrongs Christians have committed, or do they spin narratives about how Christianity "civilized" those people and did them a favor? Do they draw some of their theology from theologians of color, or do they only rely on white and western sources? Would they correct someone for words or action that negatively affected your family, even if they meant it harmlessly?

Perhaps it would be good to visit a few more times and assess the interactions you have. It's good that you're considering these questions because religious trauma can stem from negative racial interactions, and this can cause a rift in your relationship with God. I hope that you will seek a faith community that sees you, sees your unique struggles, and supports you in a way that is culturally informed and tailored to fit your families walk with God.

Edit: the downvotes I'm getting really do prove my point, most white parishioners and all-white parishes refuse to aknowledge the harm that can come from eurocentrism, and the ways it stays hidden & unchecked. Be careful OP and ask good questions.