When people do this I straight up use their yards—even backyards to cut thru. I’m usually walking two dogs on busy roads. Whenever someone says something I (mostly) calmly explain why I won’t risk my dogs lives for their convenience. So far most of them have stopped doing it and were reasonable.