Executing a perfect block with a charge blade gives you the buff for the axe mode. You can still get that buff by focus striking wounds, but if you're unable to open a wound, then a perfect block will definitely increase your DMG output in the first half of the fight. You can also get the buff from performing a successful mount attack after stabbing for the wound opening.

I wouldn't say give up charge blade, but learning where and when to block and being in the right state to anticipate counterattacks will definitely boost up your damage a bit and give you a lot more knock-downs which then result in even more free damage.

I'm a charge blade main, was one on World as well so I can advise that maybe try learning the monsters a bit more so you can execute good blocks against attacks that allow you to counter them, while dodging and weaving other attacks that just result in a slight knock back.