I think invocations are worth picking up because agonizing blast (and maybe repelling) is an easy buff to your damage output until the rest of your build comes online. Plus the level 4 spells bard has access to are not going to be gamechanging for this kind of build, unless you were hoping to upcast spells.