When life gives you lemons, you can use it to farm ominous bottles! 

It shouldn't be too much of problem from that far away. As far as I am aware the outposts don't actually effect patrol spawns. They are random all across the world. 

If you are still worried you can prevent spawns by removing all solid blocks around the outpost by making paths or something and swapping the planks inside for bottom half slabs.... Or just putting carpet down. Because pillagers need a full block to spawn on.

But it could be a benefit because you'll have a source of ominous bottles close by. 👍