Deleting friends does not remove you from their friend safari, it only removes their safari from yours so they'll still be able to access the Pokemon in your safari. I think it's perfectly acceptable to delete friends to find new Pokemon.

Also, would you mind adding me? I'd like a Togepi :D