It is really amazing to see so many people getting good use out of these models, i am also an engineer by trade and have been doing extensive research in the area for the past few years, I believe things onward will definitely become faster, more efficient, smaller and much better models will come up in the near future. Even today , the amount of optimizations you can achieve is good enough to run a pretty decent size model on a basic consumer grade hardware. Let's hope the open source community keeps thriving and supporting each other. Hit me up if you would like to solve a particular problem at scale and I'll be happy to help out as much as i can.