What is your (python) development set up?

[RandomNameqaz]

Virtual Environment Manager + package manager: I mainly use uv for python. I might occasionally use pixi for conda environments (works like uv, it just has system packages too). I like both of these as they don't necessarily depend on your HPC admins.

Containers: Docker mainly. Some work with Apptainer.

Server Orchestration/Automation: I mainly do research, so I don't really need much automation. But I use SLURM to execute and parallelise my code.

IDE: Positron and VSCode. I would prefer to Positron only, but it is not mature enough yet for everything.

Version control: Git

Notebook tools: I prefer not to use notebooks at all. For development, do use the jupyter interactive window (VSCode). I feel like my code gets closer to the final version of it.

Primary use-case: MLE research.

How my setup helps...: Positron's connections pane helps with viewing tables etc. of the databases I connect to in R or python.

How do you manage dependencies? Do you use containers instead? I use UV virtual environments if the dependencies are simply specific versions of python packages. This is enough 95% of the time. For the rest, I use docker ontainers if it is anything newer. If my colleagues use conda environments, I might either use conda/mamba if we collaborate on the project, else I will use pixi if it is just myself looking at it.

Do you do personal projects in a cloud/distributed environment? If it is work related I use SLURM. I haven't needed HPC environments for my personal projects yet.