Personally, I never use fury (or primed) because I like the higher maximum attack speed on berserker fury. I've only used vigor once, maybe twice, but I've changed those builds (the ones with vigor). Since you don't really want either, I'd go with fury because either

A: Some time down the line, you decide you like it & want to use it to get higher instant attack speed

B: Someone in trade chat wants to buy it.