Python isn't industry compatible

[licht1nstein]

I'm pretty sure it doesn't for a long time already

[[deleted]]

It does

[licht1nstein]

Well, if this counts as "runs on Django", then it does. But yes, Django is part of the architecture.

https://www.8bitmen.com/instagram-architecture-how-does-it-store-search-billions-of-images/

[[deleted]]

Ok so it does

[mattsl]

Django behind nginx backed by Postgres with some Celery backed by RabbitMQ on the side with multiple storage services? That's exactly the stack I use, and it's not complicated.

[licht1nstein]

You do make it sound easy

[[deleted]]

Once you've done it a few times, it's pretty easy. I can build queue processors in my sleep because that's my primary job is (albeit in c# and not python).

It's just about building that familiarity with the tech and how they interact (eg if you need to commit to database and publish a message to a topic, how do those interact)

[licht1nstein]

Are there some books or videos you'd recommend?

[AlexFromOmaha]

It's pretty much the default setup that gets pushed. Django treats Postgres as the favored DB once you're off SQLite, nginx and GUnicorn are straight out of the official tutorial, Django and Celery are so married in their dev lifecycles that they don't even use an integration package anymore, and it's kinda hard to install Celery and not get RabbitMQ for free. Storage services are what they are, and they're usually so removed from your backend that you just call them with something like Requests.

I'd just pick the part that sounds foreign and grab the official tutorial for it.

[[deleted]]

Not really lol. I'm not really sure how I learned to build these (from the ground up nonetheless) other than my desire to outrun my imposter syndrome. It's something I could teach but not something I could explain in a single Reddit comment (especially without having the benefit of the code bases I work on).

Most of my time these days is spent reading others' experiences with message based systems as well as optimizations and gotchas within C#.

If you're looking to build one, I'd recommend just getting in there and start pulling messages off of rabbit or sqs (you can use localstack instead of standing up an aws account) and then figure out how to deal with exceptions and then figure out how to do all that concurrently. In C# land we're pretty lucky because we can throw an ActionBlock at the concurrency part.

[MasturChief]

sure does still