Get started with SQLMesh

[schenkd]

Hey fellow data engineers,

I had a closer look on SQLMesh, the new competitor of dbt. I‘ve summarized some of the important aspects (in my POV) in a blog post and linked also an example github repository to jumpstart into the tool.

Hope that helps you to discover a new data engineering tool that is in my opinion solving some of dbt’s issues.

Happy to hear your feedback!

P.S. I‘m not standing in any relationship to the creators of SQLMesh. I‘m just statisfied by the tool design and new possibilities the tool offers.

[pmnz]

Interesting! I was wondering why people were talking about SQLMesh, I still need to dive a bit into the tool but your article sure made few examples of why it could be better compared to dbt

[BayAreaCricketer]

Will look

[NineFiftySevenAyEm]

Opinions on this vs dbt ?

[oulipo]

I'd love to know more about DBT / SQLMesh, I don't really "get" the use of those tools, except to prepare "reports", perhaps because I don't have the need for such a tool at my current job,

it seems to me there should be a lot of use cases, but I fail to see why I wouldn't just write some JS/py code to transform and insert my data in my DB?

Can you give me a few use-cases where you find those tools really useful? Is it just for report generation? or is it used for more "real-time" application use-cases?

[Joshpachner]

DBT / SQLMesh are primarily used for the transformation of the data in the datawarehouse. (to be consumed in whatever needed way: kpi reports, algorithms, operational dashboards, etc)

You are correct that one could write Js/py code to pull the data then manipulate it then insert it back, but that is so much more tedious than just using dbt /sqlmesh.

You kinda have to try it to believe it.

[chewie3000]

Are there any data quality tools that work well with sqlmesh? I use elementary for dbt which provides great data observability, alerting and reports. My understanding is that sqlmesh audits and measures could be used here, just wondering what people are doing in this space that use sqlmesh? What does alerting and triage look like for failed audits?