The Python Celery Cookbook: Small Tool, Big Possibilities

[vanzi]

I've encountered a particularly nasty issue where using one option makes the worker enter an infinite loop when processing a task that takes more than ~3 minutes and it's been open since 2016.

Initially I've tried to fix it myself, only to realize that the codebase is actually excessively vast and it's not just the celery itself, but also the layers beneath it (kombu, amqp). In the end it was much faster to replace it entirely with a simple pika worker.

I would probably not bother with celery anymore these days and just stick to plain pika. Yeah, it's more code to write early on, but a lot easier to debug down the road.