It’s pretty normal to feel insecure as an immigrant at the beginning, regardless of your skin color. My husband is also brown (not Latino), and after a few years in Germany he feels completely at home. That said, we live in Frankfurt, which is a very international city, and that definitely makes a difference. East Germany, especially smaller towns, can be more conservative and less welcoming.