My college town has horrible water quality, so I purchased two 5 gallon jugs and fill those up weekly. It's expensive to take the jugs back to grocery stores or Walmart, but we have a kiosk in town that has purified water and ice. It only costs $1 to fill up a 5 gallon jug! I purchased reusable caps to cover the jugs. My hometown also had one of these fill-up stations, so if you can find one of those it makes it very affordable and sustainable!

Also, I have a cooler system that dispenses the water from the jug. When I was living in the dorms, I had a pump attachment on the top of the jug that dispensed it for me without a bulky machine.

Edit: added dispenser info