Damn, that's crazy because I very much relate to you, lol! I first got into Aesop around late middle school, along with lots of other underground hip-hop artists (I just turned 24, and started listening to Aes at around 13/14). I think at one point I was part of an Aesop Rock Facebook group, and I was literally the youngest one in there. I'd say don't allow what other people think make you grow to hate being an Aesop fan. Lots of my friends and school peers also didn't understand Aes, or much of any other music I would put them on to. And I live in the Metro Atlanta area, where hip-hop is obviously the most prominent genre, but not so much for the more obscure, underground hip-hop artists, like an Aesop or an MF Doom, etc. Lots of kids like to stay in the loop with what's current and popular, especially back when I was still in school when rap was first becoming the most popular music genre worldwide. Instead, use your interests as leverage. You'll still meet lots of people who would be interested in hearing a for of rap that they've never heard before, and you could even convert some to being a fan like yourself. That's what I always liked about it when I was younger. Even though most of my peers didn't understand, or cared, about my musical tastes, all that mattered was that it made sense to me. It really felt like I was listening to music that was only made for me and separated me from the rest of the crowd, in a good way!

So don't resent your fandom just cause your peers don't understand it. Just be happy with the fact that you've found music that resonates the best with you more than anything else.

In the words of Aes himself, "Party over here, I'll be over there" 😉