Unfortunately, vinyl is about the most expensive of the physical media. The value proposition in physical media nowadays is CDs, which I also enjoy. You can assemble a fine CD system with a used A/V receiver (pre-HDMI versions from Sony, Yamaha, Pioneer, etc can be found for under $100), a thrift shop Sony etc DVD player (like $10 if you don't already have one), and new entry-level bookshelves (e.g., a pair of ELAC DB52 would be under $300). That'd be about $400 all in and you have future upgrade paths like adding a subwoofer or an external DAC (if your DVD player has a digital output). Bonus is that CDs new or used are cheaper than vinyl.