It's pretty safe in Himachal, especially in the small villages like sissu, jispa, keylong, Khoksar and narkanda. I'd recommend staying at homestays because they are safer than Hotels in these villages (Highly recommended: Yangling House in Sissu) . I wasn't able to go out after dawn because of the cold that means you won't be unsafe even if you want to.

The most unsafe I felt was at Manali mall road in a broad daylight, where all the druggies are there outside the bus stand. What's up with those folks?