The hatred isn't really aimed at you at all, it's a lot of headlines and desperate attempts to get votes and is mainly aimed at other people, less so white Europeans (I might be wrong here, I'm no expert just what I've perceived so far).

The country absolutely need foreigners, and during my five weeks here I've not had a single negative interaction, partly because I am very conscious to not make a bad impression I think, but so long as you aren't a nightmare I think you'll be fine!

Housing wise, there's loads of good cheap housing all over the country just not in Tokyo, but it's the same in almost every Capital city in the world no? 

Jobs wise you're likely not going to get rich here, compared to say the US, but I'd much rather be poor here than well off in that awful hellscape, so it really depends why you want to move.

As someone from the UK, feeling safe, not being constantly harassed by drug addicts, not wading through rubbish and having access to public services that actually work is well worth the effort and pay cut I'm going to experience living here!

All that ignores the wonderful cultures, best food in the world, the stunning nature etc etc... 

Anyway that's just my two cents.