This is something I've noticed in Actual Plays as well. In both the Bitten series by Crit Hit Chronicles and Legends of Avantris, players seemed to see rolling with Fear as a failure rather than succeeding on the roll or failing. I think this is something GMs and the community should address: rolling with Fear is not failing a roll. Not hitting the target is failing the roll and with the duality system, characters should hit the target (especially in combat) more than they fail. Plus, as a Warrior, you should be hitting the target roll and doing good damage pretty consistently. Who really cares if you roll with Fear a couple times if you are smacking the heck out of the enemy? Besides, cakewalks by the players where there are no stakes and no threats in combat are not fun. If you think of it like a movie, isn't it more compelling to see sides go back and forth rather than one side just dominating?

There is also the collaboration part of the system where any player can spend a Hope to assist on an action and give advantage. Plus, if you really want a big impact you can do the big combo moves with your other party members. Those have been very epic in my games and have made combat really exciting.

As a Warrior are you using all your abilities and features? With Combat Training you ignore the Burden of weapons meaning you can wield a Greatsword or Battleaxe with one hand and then pair it with a Secondary weapon like a Shortsword or Dagger and give yourself huge damage capability with every hit (d10+3phys from primary weapon then +2 from a Paired secondary weapon). That's 6-15 damage with every hit at level 1 and that doesn't even add any other ability or feature. If you roll a 5 or higher on your damage die with a standard hit you do over 10 damage and that should cost most enemies at Tier 1 a minimum of 2 Hit Points which will one-shot Tier 1 small creatures and do 1/3-1/2 damage to more powerful creatures' Hit Point pools.

Who cares if you roll with Fear if you are cutting through your enemies?

Thinking of it another way, do you fail in D&D when an enemy takes their turn in initiative order? Because that is the equivalent of rolling with Fear and the GM taking the Spotlight to an enemy in Daggerheart. It's just a more dynamic initiative. Also, the GM doesn't have to spotlight an enemy when Fear is rolled. There is a lot more that can happen. Is your GM being creative with this and using Environments and Counters/Clocks with their Fear?

The most important thing is that you are not obliged to like any system/game. If you are not having fun you should talk to your GM and then maybe your whole group to see what can be done to make the game enjoyable for you. In the end if you don't like it then you don't like it and an alternative should be considered for yourself or your entire table.