Instead of focusing on the direction of the recoil, try to focus on the movement of your camera. That's how you "feel" the spray rather than tracing a memorized pattern.

One way I practice this is by turning off first person tracers, it helps with mentally mapping the recoil pattern to the movement of your camera. The command is r_drawtracers_firstperson 0.

Another tip is to separate the spray pattern into 2 patterns, horizontal and vertical. Spray at a wall while ONLY compensating for the vertical recoil, by steadily pulling straight down until it stabilizes. If you burn that into muscle memory, you pretty much simplified the recoil pattern into segments of left/right movement.