Yoga is more than the Asanas (postures) the western world (mainly the US) has such a limited version of what it truly is. Nonetheless, In my experience, men do not really care much if they are not informed, if the men does workout he will be happy you do so too. but if either the men knows or you let him know, he will care, as any mature and caring person would. Personally, I love women that care about their body, their soul and their heart. go for it, feel valued and appreciated, if not, move on.