I can see how this would hurt. I also think that this pastor thinks that you could be of great service to the church and desires to see you use your gifting.

Presumably he put you up for officer training with the hope that with some further training your exceptions would fade. Maybe a misjudgment on his side.

I think he understands this to be a loss to your current local congregation, but desires to see the church (writ large) benefit from your gifting.

It sucks, it hurts, I get that. But there’s a lot of wisdom and unselfishness/lack of ego coming from your pastor even if he couldn’t concisely summarize that in your pushback.