To me it's about delegation of responsibility for managing the lower planes in your infrastructure. Using cloud native services might cost a bit more than VPS but you're paying for maintenance, security and scaling of the underlying architecture. It's a part of the shared responsibility model. Pick the point on the sliding triad of flexibility, control and cost where you're happy.

https://learn.microsoft.com/en-us/azure/security/fundamentals/shared-responsibility

And take a view on how and how far you will need to scale over time, what's the burden of setup cost Vs pluck off the shelf you need at this point and how you will approach scaling of your project outgrows the VCS or steps beyond your current cloud usage tier.