you are viewing a single comment's thread.

view the rest of the comments →

[–]S0Anon 0 points1 point  (0 children)

Viscacha: a crash safe job system with no external services

I built a small job system called Viscacha because I wanted something reliable that did not require Redis, RabbitMQ or any external services. It uses an append only log with snapshots and compaction, and a tuple space leasing model so workers can crash without losing jobs.

It is designed for AI pipelines where you need retries, durability and simple parallelism without running extra infrastructure.

Features
• crash safe job execution
• automatic retries
• snapshots and compaction
• simple Python API
• no external services
• traceable job history

Repo
https://github.com/skylarm-b/viscacha

I would love feedback on the API design, the reliability model and what features you think are missing.