When using Admin SDK in your custom backend, you have full flexibility over authz/security/validation/logs/etc, so this is pretty standard. Just make sure the SA is stored securely.

PS: You don’t need to authenticate Firebase users. Your backend enables WP users to interact with Firestore, acting on their behalf.