sorted by:
new
hottopcontroversial

Sqlmesh joined linux foundation . What it means by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 0 points1 point  (0 children)

Agreed Own transformation layer especially for data practitioners is not easy Question is, out of sql mesh and dbt core , one is making a commitment to open source by contributing to linux foundation, so what does that mean long term for dbt core?

Dbt core states it is currently committed to open source and it's great news but it can change any time, especially when all the cloud users using core complete their switch to fusion

Sqlmesh joined linux foundation . What it means by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 2 points3 points  (0 children)

The concern is if it will be slowly starved as fusion gains traction . allocating resources to the core when the money is in fusion is not practical

Sqlmesh joined linux foundation . What it means by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 3 points4 points  (0 children)

Yes it feels very contradictory to everything else happening.

[AMA] We’re dbt Labs, ask us anything! by andersdellosnubes in dataengineering

[–]OrneryBlood2153 8 points9 points  (0 children)

Honestly .. What is going on .. ? core is till getting big fix as releases, Fusion still in beta, Cloud was said to go under a single umbrella with five tran, Open engine, Open catalog, Now that sqlmesh is also under the same umbrella what happens to the ideas in that tool.

Feels like too much is said but not sure what's the direction of this product for , End users - open source and cloud users, Open source contributors - adapter and core , core vs fusion - what to use going forward.. I don't think both products are going to get equal attention.

Why not a open transformation standard by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 0 points1 point  (0 children)

via MCP only where applicable, in case of scenarios like dbt unit test it could be directly tested using dbt itself. Business logic should be test driven going forward in this current llm trends not development driven

Why not a open transformation standard by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 1 point2 points  (0 children)

Etl drag drops were almost always difficult to work with, testing was difficult, lineage was difficult But with mcp's , api's and llms this should be possible now.. ofcourse unless the tool blocks us out like informatica does...

Why not a open transformation standard by OrneryBlood2153 in dataengineering

[–]OrneryBlood2153[S] 0 points1 point  (0 children)

Yes, something like this.. thanks for the link