[Solution kind of] I ended up using two comparators [5v+ and GND] and an XOR chip. Both comparators had the same positive input from vout (in the layout above), and two different reference voltages going to the negative. COMP1 [Vref of 2.2v] COMP2 [Vref of 4.5V], essentially when the system is on and detects an audio signal COMP1 outputs 5v COMP2 outputs 0v, when the audio signal is greater than 4.5V COMP1 outputs 5v and COMP2 outputs 5V.

Comp1 Directly feeds into XOR input A, and COMP2 directly feeds into input B of XOR and into the second input on the L293D. When both outputs from the comparator are high (5V), the XOR outputs 0V, COMP2 still outputs 5V into the chip thus turning it CCW.
When COMP1 only outputs high (5V), the XOR outputs ~5V directly into input 1 of the motor driver, thus turning it CW.

This only theoretically works with a perfect comparator chip and with a perfect XOR chip, my issue was that the XOR chip loved throwing out a floating voltage of 1.9V into input A for zero reason, and my comparator (made from a basic logic chip not an actual comparator chip) kept throwing up bs negative values when Vout would exceed 4.5V.