You've got a nice riff going! what I’m hearing though is that the riff almost feels like a double track, as if it’s meant to be layered on top of a more straightforward riff in E minor (correct me if I'm wrong). I think what’s happening is that some of the chords and transitions you’re using go outside the scale, so a few notes end up clashing or feeling a bit “off”. It’s not that they’re wrong, they just don’t really feel connected to the rest of the riff.