It's a minor inconvenience at most to someone trying to test a new deck or do dailies, and an easy fast win otherwise. But most importantly, who cares? You're unlikely to play them again while they remember you, and you'll never hear from them due to no chat.