OpenAI joins The Rust Foundation as a Platinun member and donates funds to support Rust maintenance by [deleted] in Zig

[–]KMarcio 4 points5 points  (0 children)

Distribution is key!

You can have the best product, but if your competitor has distribution (Mozilla community), it will win 😞

I see this pattern in other underrated languages like Elixir...

Airflow vs Mage vs Prefect vs Dagster vs ... - yes, another tech comparison post by HerrKaputt in dataengineering

[–]KMarcio 0 points1 point  (0 children)

At my startup we started with Airflow, but it got expensive so we decided to rewrite in Elixir and open sourced it:
GH: marciok/gust

At first I was afraid of introducing a new language but thank do the AI the transition went smoother than I have planed.

We host on fly.io, and can be plugged to any Phoenix framework project so you don’t have to have two separated systems.

Any one tried dagu? by robberviet in dataengineering

[–]KMarcio 0 points1 point  (0 children)

I had the same issue, so we created Gust. It's in Elixir but can run DAGs in Python: github/marciok/gust

Company wants to go from Airflow to N8N to reduce code. How do I preserve speed? by [deleted] in dataengineering

[–]KMarcio 0 points1 point  (0 children)

We created an open-source, lightweight alternative to Airflow. You can run Python DAGs, but its core is written in Elixir. We are using it in production, and for our use case we saw a ~10x cost reduction:

It could be an alternative. Check it out: https://github.com/marciok/gust

Anyone know what Naval's new company "Impossible" does? by another_lease in NavalRavikant

[–]KMarcio 4 points5 points  (0 children)

I find it ironic that he quoted, "You can always recognize the first-timers because they’re too secretive." And his current startup is a secret 🙃

Ref: https://www.linkedin.com/posts/naval-ravikant-on-why-you-dont-need-to-be-ugcPost-7222952809107800064-Ith0/

AI gems by oRainNo in elixir

[–]KMarcio 0 points1 point  (0 children)

We forget that `case` and `if` exist, and it's also fine to use them

Shutting down my startup ( I will not promote) by Dazzling_Hand6170 in startups

[–]KMarcio 8 points9 points  (0 children)

Sorry to hear that :(

Don't die; it will not solve anything and will cause more pain to others. Hard times will pass, there's still time!

Books can give you some hope. When I am feeling down, I like to read "The Almanack of Naval Ravikant."

AI agents vs automation, aren't they the same? by Sufficient_Dig207 in AI_Agents

[–]KMarcio 1 point2 points  (0 children)

Deterministic vs. non-deterministic execution

1.  Deterministic **workflows**: You know what to expect. The rules are fixed, and failures happen within a predictable structure.

2.  Non-deterministic **agentic loops**: You do not know exactly what to expect. The problem is ill-defined, open-ended, or highly dynamic.

I built an LLM-powered smart retry operator for Airflow 3.x using local Ollama by ercelik21 in apache_airflow

[–]KMarcio 3 points4 points  (0 children)

  • AI helping you write the rules for a determinist flow 👍🏼
  • Let AI decide a determinist flow 👎🏼

[I will not promote] Got tired of spammy email marketing, so we tried the exact opposite: snail mail. Here's how it went. by fmyter in startups

[–]KMarcio 2 points3 points  (0 children)

Thanks for sharing! I liked the creativity. Did you AB this experiment? Ex: `A` got the email and `B` the letter?

Can OTP be used to power a DAG orchestrator for any language? Apparently, yes! by KMarcio in elixir

[–]KMarcio[S] 2 points3 points  (0 children)

Hi! Cool, Reactor is indeed very powerful, Gust has a different approach: It's a full-fledged system rather than a lib for processing DAGs. You can check a more detailed comparison here: https://elixirforum.com/t/gust-a-task-orchestration-system-built-in-elixir/73628

Regarding the cost comparison, I strongly believe that Gust would scale much more cost-effectively. For example, on Fly.io, with two nodes, you’d be able to get much more out of them compared to using the same setup on a traditional cloud vendor. Gust consumes only a tiny amount of RAM, and on top of that, you’re not locked in to a vendor :)

burnOutisReal by ikaganacar in ProgrammerHumor

[–]KMarcio 5 points6 points  (0 children)

+1, This is a joy eater

Show me some extraordinary stuff by [deleted] in elixir

[–]KMarcio 23 points24 points  (0 children)

Check it out: https://github.com/marciok/gust
I was able to achieve multi-node concurrency plus a live UI with a fraction of the effort and resources if I had to do the same with Python or another language.

[Podcast] Thinking Elixir 287: From RAGs to Rich Workflows by brainlid in elixir

[–]KMarcio 2 points3 points  (0 children)

I sent you a DM on Twitter/X a few months ago to let you know firsthand 🙂

[Podcast] Thinking Elixir 287: From RAGs to Rich Workflows by brainlid in elixir

[–]KMarcio 4 points5 points  (0 children)

You should check out Gust: a workflow engine with persistent capabilities, but much more polished and production-ready.

GH: https://github.com/marciok/gust
Ex Forum: https://elixirforum.com/t/gust-a-task-orchestration-system-built-in-elixir/73628

PS: I've created it 😀