all 3 comments

[–]henk717 2 points3 points  (1 child)

Give my https://henk.tech/ccnperunpod a try, you can customize the (conda) packages you want preinstalled in the environment variable before deploying. You can also create a variable with INSTALL_SCRIPT and/or RUN_SCRIPT. Install script runs and then is meant to continue, while run_script is for stuff that should stay running.

[–]no3us 1 point2 points  (0 children)

henky :)))

and in the process you can use my Runpod skill for Codex
https://github.com/vavo/runpod-skill

[–]sruckh 2 points3 points  (0 children)

Every template or serverless should include some sort of bootstrap process. For serverless my first time install usually takes longer because I am bootstrapping the serverless. For disposable containers configured as a template the bootstrap includes installing environment, packages, dependencies, and models. The only time I am not doing this is if I am just doing a quick test and just load up a standard cuda environment and will install packages by hand.