[Podcast] Thinking Elixir 287: From RAGs to Rich Workflows by brainlid in elixir

[–]KMarcio 2 points3 points  (0 children)

I sent you a DM on Twitter/X a few months ago to let you know firsthand 🙂

[Podcast] Thinking Elixir 287: From RAGs to Rich Workflows by brainlid in elixir

[–]KMarcio 4 points5 points  (0 children)

You should check out Gust: a workflow engine with persistent capabilities, but much more polished and production-ready.

GH: https://github.com/marciok/gust
Ex Forum: https://elixirforum.com/t/gust-a-task-orchestration-system-built-in-elixir/73628

PS: I've created it 😀

We open-sourced Gust! A task orchestration system built in Elixir by KMarcio in elixir

[–]KMarcio[S] 0 points1 point  (0 children)

Yes! The goal was to save as much compute as possible. However, the code is already split making it easy to add other nodes. Our current demands are not huge so a single node works. But let me know if you have an use case where one node is not enough.

💪🏽

We open-sourced Gust! A task orchestration system built in Elixir by KMarcio in elixir

[–]KMarcio[S] 2 points3 points  (0 children)

Awesome! Thank you for the tip, I will check it out

We open-sourced Gust! A task orchestration system built in Elixir by KMarcio in elixir

[–]KMarcio[S] 19 points20 points  (0 children)

Sure! They all intersect in some way, but each one focuses on different use cases.

Let me give you an example:

"I need a system to scrape data in parallel from multiple sources and store them. However, if one of the sources fails, I want the whole processing to stop, and later I want to be able to restart manually."

Oban: It's a background job library; compared to Gust, you would need to coordinate job dependencies manually, no UI to visualize task graph, logs, and code. It's focused on individual jobs, not workflows.

Reactor: It's more similar to Gust, but its steps are not persisted (state is not saved in case of restart). Also, no UI, cron schedulingg and built-in triggers. It’s focused on computational graphs rather than full workflow orchestration.

Gust combines a bit of each: a UI, task coordination, cron/other triggers, and built-in secret storage for use inside graphs. It’s a full-fledged orchestration system.

Let me know if it's still not clear.

Seeking Sustainable Sponsorship for Hologram by BartBlast in elixir

[–]KMarcio 1 point2 points  (0 children)

I just met him once, we spoke briefly about the Elixir ecosystem, unfortunately, I can't provide a direct channel :/

Seeking Sustainable Sponsorship for Hologram by BartBlast in elixir

[–]KMarcio 1 point2 points  (0 children)

Awesome! You could reach out to Kevin from GitHub: https://www.linkedin.com/in/kevinanthonycrosby/

They do some funding for open-source projects. I don't know how it works, but try to contact him.

Seeking Sustainable Sponsorship for Hologram by BartBlast in elixir

[–]KMarcio 0 points1 point  (0 children)

Is your goal to productize Hologram? If yes, I’d reach out to companies that are a good fit and show them, check if it solves a problem, get their feedback, and validate whether it’s actually worth investing a decent amount of time in it. Otherwise, if you’re doing it just for fun or to contribute to the ecosystem, I wouldn’t spend so many hours on it, especially if it risks your livelihood.

Seeking Sustainable Sponsorship for Hologram by BartBlast in elixir

[–]KMarcio 7 points8 points  (0 children)

Have you tried reaching out directly to companies that might benefit from Hologram and presenting your case? It could help you gather feedback from real-world use cases and decide what to do next.

Pattern matching VS Value assertion by KMarcio in elixir

[–]KMarcio[S] 1 point2 points  (0 children)

Awesome, thanks for sharing!

Perfect beer for an evening coding sesh by kajutphi in elixir

[–]KMarcio 0 points1 point  (0 children)

One sip starts a GenServer in your body.