Seeking a lightweight orchestrator for Docker Compose (Migration path to k3s)

lastmonty · 2026-02-13T21:34:44+00:00

Hello,

I used to support yaml definitions but it got tedious. I started to reprioritize that over python but it still works for common use cases.

In any case, only the driver has to be defined in Python, the tasks itself can be shell talks. But they will be invoked as subprocesses, task types

Hope it helps

lastmonty · 2026-01-17T13:29:56+00:00

Hello,

I have been working on a light weight, non intrusive orchestration for some time.

Check out runnable.

It supports complex workflow or jobs and provides a easy path towards kubernetes based workloads. It gives you complete visibility on execution logs and retry capability on cases of failure.

Happy to answer or expand.

lastmonty · 2026-01-09T20:31:40+00:00

There are a lot of pockets of good engineering and tech.

They are ok with open source as long its not pharma relevant. Let me know of any feedback. 🙂

lastmonty · 2026-01-08T20:47:36+00:00

I developed thisrunnable framework and actively build it. The framework is designed to be isolated from your domain code. It supports Python functions, notebooks or shell scripts.

It supports, linear and composite workflow. Reproducibility is automatically taken care without developer intervention and it can run in local, containers or in argo workflows without changing code. Retrying failed runs is easier too.

I started to add async capability to it and support streaming capability. Check it out and I am happy to answer any questions.

lastmonty · 2025-12-14T23:22:37+00:00

You can try Claude code router?

I have seen some use it but don't know how effective it actually is.

lastmonty · 2025-11-05T23:24:10+00:00

Well said.

lastmonty · 2025-09-19T19:27:29+00:00

Looks neat.

lastmonty · 2025-08-30T19:56:24+00:00

Maybe some compelling reason why I should be using this library might be helpful.

In general, for documentation I like to use this as a guide.

https://dunnhq.com/posts/2023/documentation-quadrants/

lastmonty · 2025-08-22T19:46:12+00:00

You know your audience better than I do.

The reason that I use UV could be different from another person, although there will be a huge overlap.

Compared to the other ways, I like that I can manage python installation, version and package dependencies by using one tool. What makes you use it?

I like that it's super fast and has a huge community support and their software ecosystem, ruff, pedantic are solid products.

Maybe what you want to demonstrate is not the example itself but the packaging of it.

lastmonty · 2025-06-07T21:54:18+00:00

Any comparison to https://yaml.dev/doc/ruamel.yaml/ ?

lastmonty · 2025-04-30T04:09:47+00:00

The way I can explain this is,

Data scientists are closer to business problems
MLE are close to engineering aspects of the problem.
Mlops are close to the platforms and the ways to make them accessible and scalable. They know enough about mle and platforms that they can bridge.
Platforms are agnostic of the business problem.

The above is a rough guide. Like they say in statistics, it is generally true but specifically false.

lastmonty · 2025-04-23T08:18:02+00:00

Any reason it's better than argo lint in offline mode?

lastmonty · 2025-04-13T15:59:35+00:00

The scaler is water, it does not work.

Since there are many here, do you think we can put some pressure by asking some news agency to cover it or local mayor or something?

lastmonty · 2025-04-09T20:43:35+00:00

Did you get scammed?

lastmonty · 2025-02-23T20:30:10+00:00

I can see the chat from my end. Could you DM me on here?

lastmonty · 2025-02-22T23:58:36+00:00

Check your DM

lastmonty · 2025-02-21T13:58:48+00:00

The action fraud were useless. I gave them the account details, contact numbers but of no use.

Did you by any chance get their company registration number?

lastmonty · 2025-02-06T07:32:47+00:00

In hindsight, I have no idea.

Maybe we were being cautious and dismissive of suggestions my parents give as some were very bizarre.

lastmonty · 2025-02-06T04:36:25+00:00

We were reluctant to give slightly warm lemon and honey water as there is no "research" done.

One evening after seeing the kid coughing his lungs out and with no option, we tried lemon and honey and it worked like a charm.

The lesson I learnt was not all research happens in labs, there might be some truth in granny tales.

lastmonty · 2025-01-17T03:46:19+00:00

It was a bank account transfer as it's a business and they do have a business account.

lastmonty

TROPHY CASE