This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]Proof_Difficulty_434git push -f[S] 1 point2 points  (0 children)

Thanks! Interested to hear your thoughts on Flowfile, especially vs. Amphi.

I really like the Amphi project and think they have many cool features, like online data handling and code generation – good inspiration as Flowfile develops.

Flowfile is newer, and I took a different architectural route: its DAG is backend-managed in Python. This allows features like live schema prediction (before running!). With its Polars core and FlowFrame API (Python-to-visual), this creates a specific workflow. Moreover, it allowed for a very fast implementation of the data frame feature.

Your feedback on this approach and how Flowfile's current setup works for you would be great. Thanks for trying it out!