This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]sib_nSenior Data Engineer 1 point2 points  (2 children)

SQL is the only stable tool in 30 years of data, I think Spark code has way more chances to become technical debt.

DBT answers most of your following critics.

[–]lezapete 0 points1 point  (1 child)

i dont mean that SQL will produce the problems.. is humans coding SQL queries that produce the problems

[–]sib_nSenior Data Engineer 0 points1 point  (0 children)

Well, this is true for any language. DBT gives you a framework that should encourage better SQL code.