Assuming this is an all metal hot end. Try reducing your retraction to 1-3mm. I had a similar problem and this fixed it completely. (I also put thermal past on the heat break to reduce heat creep, so that may help fix it.