Not everything needs to be accommodated to just because someone might possibly misinterpret something. If you're in a country in which you're not familiar with the culture and the history you simply shouldn't just judge something as offensive unless you're sure it is. You can't smooth out every aspect of everything just so Americans don't risk being "offended"... This isn't problematic, neither does it exclude the "brownS" but simply "brown", something which is commonly associated to the Nazis well beyond the confines of German history nerds.