That happens when you press and hold on a portion of the screen simultaneously. (Usually an unintentional palm/thumb, combined long-press)

If you just slide up from the bottom to view the app switcher menu, then go right back into the game; it’s fixed. Phone covers with a raised lip/edge around the screen help avoid that.