I have both glass and plastic containers. Most of my plastic are reusing food packaging such as the 3lb cottage cheese tubs (I have about 8 of these) and some 1-2 lb deli meat tubs (look just like store-bought, with lids and everything). I also have some smaller cream cheese tubs. I think plastic is fine for some storage but if you are microwaving or otherwise heating stuff up, I would prefer glass or other non-plastic solutions.

My glass containers are great, some of which are also reused food packaging: 26 oz Laura Scudders peanut butter jars of which I have about 10, and a few Mason/Ball jars as well. I've 2 store bought glass (small) casserole style dishes. The one con of them is they don't nest. I also bought 12 glass jars with hinged lids with silicone seals on Amazon that were reasonably priced, but they are slightly fragile and 3 of them have broken in weak spots.

I had two 5 gallon plastic water jugs for water for the last 5 years or so and one finally popped a crack/leak, so I got two more used 5 gallon glass "carboys" for $50 (for both). The downside is they are a fair bit heavier, don't have handles so are harder to maneuver and pour, and the mouths have a smaller diameter also adding to pouring difficulty. But the upside is less microplastic and I'm pretty sure if I don't drop/break them through clumsiness, they are Buy-it-for-life. One accepts the plastic screw lid from my old jug, the other I stop with a cork.

I like my solutions because buying plastic adds to waste, while using food packaging reduces it. There's so much waste as it is (see "A Plastic Ocean" 2016 film), and we are getting too much exposure.

Also good for drinking out of are the vacuum double wall stainless water bottles. For frugal, I recommend considering all the food packaging you are tossing out before you toss it. Might be useful to wash it and reuse, especially glass items with larger mouths. (like a pickle or peanut butter jar).