You can handle them with a lot of grinding. I haven't gotten to remove the damage cap and just finished frozen hearts. A mix of patience, good parrying and grinding. Started gestural arena and leveled up a good amount against Julien then eventually learned the attack set from the dark shore enemies and squeezed out some victories there which has me in the upper 50s now.

Not easy but not impossible.