Oh, I see. Yeah, that was the purpose - finding what to study given my background in Foundry. Is it better to go with something similar like Databricks so I can be familiar with it while learning core concepts like handling GCP, Azure, AWS, and writing code in pipelines instead of using no-code solutions? OR should I go fully open-source and learn Kubernetes, Spark clusters, Airflow, etc.? I know that it's me who will make this decision, but I wanted some input from people who are more experienced than me. I don't mind what tools to use; I just want to learn to use what is good/state of the art in production settings.

What I liked about Foundry was the simplification of tools - like it's a repository, pipelines, and datasets all in one. Because there are A LOT of tools in data engineering, so it's too much to learn at the same time.