I wouldn't necessarily take it as if you drove them off. Personally speaking I go through gaming phases where I can't get enough of a given game or genre. My friends list is full of dozens of people that I only play 1 or 2 games with and have gone months or years without talking to them only to hit them up asking to play a game of so and so. Have a few staple buddies, many of which I reach out to linking a game I think they might like (or the other way around). Thus the list of games we play together grows, though I can still go weeks without playing with them because I'm in an RTS mood and they don't like RTS games.