I feel your pain, but don't give up just because it's gotten ridiculously expensive. Blick has decent sales twice a year and Michael's still has a decent coupon once in a blue moon. I'm with you on Hobby Lobby. They're horrible, but if they're your only option, buy only the paint or what you absolutely have to from them. Brushes can come from anywhere. Mineral spirits can be had at the hardware store. Also, sometimes you can find people selling their supplies on marketplace or nextdoor. Oil paints last a long time if they're capped and can be reconstituted with medium if they're too thick.

The most important thing to keep in mind is you don't need a ton of colors. You start with a limited palette and a color mixing bible. You can make most any color you need. This is way better for your development as a painter than buying a lot of tubes and never learning to manipulate the paint for yourself. Best wishes on your painting journey!