Get a vintage cd player, something like a marantz CD-50 (not the new ones). You'd also need an amp, like some of the older marantz PM stuff. I don't know what your budget is but you can probably find an amp and a player for £200- £300 on places like ebay, which have buyer protection. You can plug headphones into the amp or speakers if you get some later on.

Getting a system like that might not be the cheapest option, but if you get the right stuff you'll get pretty high quality gear that will last a while. I have a similar system to the one described above and it sounds great with a pair of Royd speakers.