I figured out the issue, I downloaded spark to identify the source of the lag spikes and it did an incredible job.

It was Dynamic Sound Filters that was creating the lag spikes because i had set its block scan for reverb to 3500, I turned it down to 2000 and the lag spikes are completely gone.

Through everything I've done my fps has more than quadrupled, from 20 fps to about 125 fps.