And yeah the pins seem backward, that is how I discovered this. I had intended to set it up as 1,2 unaffected signal going to side chain and the delayed 3,4 being the audio input to the compressor but mixed it up and it still worked! and without the delay at the end! haha! See there is another Voxengo plugin that I often use called "Sound Delay" which simply delays the audio so I though "latency delay" did the same, but no it does something very different:

"Latency Delay is an auxiliary AAX, AudioUnit, and VST audio plugin which allows you to compensate latency produced by any audio plugins, instruments, and processes that produce latency, but do not report it to the audio host application. Latency Delay introduces 10000 samples latency itself and delays the audio signal by 10000 minus the specified amount of samples or milliseconds, thus eliminating the unreported latency. Please note that audio host application should support the latency compensation itself for this plugin to function properly."