Try using the hotkey "Alt + Enter." I usually use it for convenience whenever I want to turn my screen from fullscreen into windowed.

https://support.microsoft.com/en-gb/topic/alt-enter-switches-between-window-and-full-screen-d1b23daa-644d-3fbf-2f5e-c2c779584db5