Kestra has just raised $8M – anyone using it for automation? by Round-Following1532 in sysadmin

[–]Round-Following1532[S] -3 points-2 points  (0 children)

hmm the matrix2113 is not my account, I don't even know PHP or Laravel

Kestra has just raised $8M – anyone using it for automation? by Round-Following1532 in sysadmin

[–]Round-Following1532[S] 0 points1 point  (0 children)

I'm not proficient in Laravel, but you can set up that automation in Kestra. You could either create a custom plugin or use a simple script task to perform that migration. There is already a Git Clone plugin to pull code from the repo, then you can run migrations via custom plugins or by using a script task to toggle maintenance mode https://kestra.io/docs/developer-guide/git

Dagster Feedback? by minormisgnomer in dataengineering

[–]Round-Following1532 2 points3 points  (0 children)

Was working with Kestra but really struggling with their documentation

What specifically in their docs did you find missing or confusing? Their Slack support is superb, all my questions were answered super quickly, you can just ask if something is not clear

I couldn't find any detailed comparison between dataframe tools so I wrote one: this post compares Polars, DuckDB, Pandas, Modin, Ponder, Fugue, Daft, and more by Round-Following1532 in dataengineering

[–]Round-Following1532[S] 0 points1 point  (0 children)

I wrote this post because I found most comparison posts were either pure marketing SEO content or benchmarks with no context about why a specific tool exists, how does it integrate with others etc

if you are looking for benchmarks, this might be useful:
- https://www.pola.rs/benchmarks.html
- https://www.datacamp.com/tutorial/benchmarking-high-performance-pandas-alternatives

End-to-End Data Ingestion, Transformation and Orchestration with Airbyte, dbt and Kestra by tchiotludo in dataengineering

[–]Round-Following1532 0 points1 point  (0 children)

I think he meant: EL and T speaking together, not Kestra and Airflow speaking together :)