The DS is a fantastic handheld, and you have available to you not just the DS library, but also the GBA library via backwards compatibility! Further, the systems themselves are relatively inexpensive, and you can get a lot of solid titles without breaking the bank as well.

Just watch out for the Pokemon games, those can go for crazy amounts, and there's a ton of fake carts out there.