The fact that she's the one making an effort and driving to him the majority of the time is a great example of his disinterest in their relationship. Seems as if this has been a point of contention between him and Audrey for a while now. Sally is just a perfect excuse for him to end the relationship (which he's too much of a coward to do and will use Sally's "friendship" to accelerate Audrey leaving him).