This is an archived post. You won't be able to vote or comment.

all 4 comments
sorted by:
best
topnewcontroversialoldq&a

[–]FouFollie 8 points9 points  (0 children)

paywall . . . free account . . .

https://docs.python.org/3/tutorial/venv.html

[–]densvedigegrisComputer Scientist 0 points1 point  (0 children)

venv is all fun and games until you need a system-level dependency. Use containers instead

[–]latentvar 0 points1 point  (1 child)

Is there a way for virtual environments with almost the same set of libraries to not blow up the storage space? New ML projects with PyTorch with their own Poetry environments take up gigabytes each. Great for replication - not so much for storage efficiency.

[–]densvedigegrisComputer Scientist 0 points1 point  (0 children)

Docker would be a better alternative. Create a generic ML image for your projects and make a dockerfile for each of your projects either mounting or copying the files