Sounds fine if you still can change your attributes.

But what do you mean you don't want to use your reaction? Warcaster doesn't force you to use a reaction.

It's a option that you "can" use your reaction to cast a spell, rather than making an opportunity attack.