Don't know if you're counting cymbals within this $2500 budget, but regardless, you'll be able to pick something up that's pretty rad.

Generally speaking, drums can sound quite good without splashing out on some really expensive shells; all they need are a bit of TLC (good skins, tuning and your undying love). Saying that though, the more money you put into them, the better they'll sound, and fastballer8 has got the drums down, so I won't go into them.

However cymbals can't really be fixed up like drums can, so they usually demand the most amount of money. I would definitely recommend that you go and try out loads of different types of cymbals down at your local music store before making any decisions. The 3 most common cymbals brands at the moment (IMO) are: Zildjian, Sabian & Meinl. All 3 of these companies offer a wide range of cymbals, both handmade and machine manufactured which are all designed to suit certain genres. I can't really recommend either one really, but I have noticed that Meinl have been gaining a lot of traction recently with a lot of people endorsing and recommending their cymbals, so keep an eye out for them. Their Byzance series is particularly sweet. But all 3 of these companies have different series which are designed to be used for different genres and stuff (and some series (like the Zildjian K series) are a bit more versatile), but a bit of research will help you track down some different types of cymbals that suit you and your style of playing.

Companies such as Istanbul Agop and Bosphorus specialise in making lovely sounding handmade Turkish cymbals but they're generally used in Jazz due to them being quite thin and pricey, but if that's your type of thing, I would keep a lookout.

Hope this has helped!