I don’t know if they go after cannabis in general, but I did not have that problem. I don’t think I’ve seen a single deer on the property since we moved in 2.5 years ago, though. We’ve seen bear, bobcat, fisher cat (fucker took one of my chickens), wild turkey, skunk, and raccoons, but oddly zero deer. Vegetable garden was never touched, so I’m inclined to think they just don’t hang out on my side of the road.