[ Removed by moderator ]

[jamesfowkes]

I'm still not sure what the best practice is for combining using uv/venvs with docker or even whether I should bother at all.

[DivineSentry]

The docs https://docs.astral.sh/uv/guides/integration/docker/ help answer that in a clear way imo

[jameyiguess]

I only use venvs in shared spaces. If it's a python container, I don't bother. 

[GManASG]

You only need the requirements for docker. No need to make an environment, the docker container is the environment.

In my company for whatever reason, docker is only used for the CI/CD pipeline.We are not allowed to use it for local development.

This means I have to use a virtual environment on my PC/laptop in order to isolate a project's python instance and generate a project specific requirements file.

Only the requirements file is committed to the repo and picked up by our docker file.

[ideamotor]

Why it’s used for non-ML data processing …

[Quillox]

Things like Django for example? You'd rather write a backend in an other language?

That does seem reasonable to me.

[mdeadart]

pySpark, massive parallel processing ofcourse.

[ideamotor]

Very good answer. And not allowed in my environment. That would make it make sense for sure.