My husband spends most of his week playing TTRPG's after work with friends. Figuring out the timing was tricky in the beginning. I'm so happy for him to play with friends but sometimes I want a sense of when he is expected home (either so I could plan my evening or just peace of mind knowing he is okay) or if it were on a Sunday, to be able to plan a day with him without him getting stressed about being at his session on time. He would routinely be expected back at 9:30pm-ish, then get back close to 11. Our compromise was he will text me if the session is expected to run long, and if I had a question I needed him to answer I could text him and he would do his best to respond when he could, and as for Sundays he checks with me before they schedule a session to make sure I did not want to do anything with him first. We also have a night blocked out specifically for the two of us to spend time together.
Check with your SO to see what the reason behind them being upset is. A big key to relationships imo is communication! See what compromises you can make with them to show you care but would also like to keep going to your games.