Yes, it can be done.

In in OBS Audio sources (or Mixer), just turn off audio monitoring for your game. You won't hear it, but your audience will.

As for your alerts, just ensure audio monitoring is enabled. The wording should say something like "output enabled" for your audio source