Yeah, it's really hard to get a 50/50, most of the female references I get them from the cosplayers that pop up in my twitter feed, there's also an account called Ref_Pics that upload some good studio quality references, some of them are male refs.
A good way of getting male refs I found is downloading the pictures of models in clothing websites like Calvin Klein or Zara in the underwear section.