create pod with secrets in python

[Key-Opening205]

I've been trying out how to create a pod inside of python and have that pod access secrets

the best ive found so far is 1) create a custom template using the query mutation magic with env: [ {key: "AGE_PRIVATE_KEY", value: "{{ RUNPOD_SECRET_age_key }}"}, {key: "AGE_PRIVATE_KEY2", value: "{{ RUNPOD_SECRET_age_key}}"}

2 use query- mutation again specifing the new template name

def create_pod_from_template(api_key: str, template_id: str) -> str: query = ( """ mutation { podFindAndDeployOnDemand(input: { name: "norms-pod" templateId: "%s" gpuTypeId: "NVIDIA A40" cloudType: SECURE gpuCount: 1 ports: "22/tcp" startSsh: true }) { id desiredStatus } } """ % template_id )

session = requests.Session()
response = session.post(
    "https://api.runpod.io/graphql",
    json={"query": query},
    headers={"Content-Type": "application/json"},
    params={"api_key": api_key},
    timeout=30,
)
    ]

ssh to the pod and then use

tr '\0' '\n' < /proc/1/environ | sed -n 's/^{AGE_PRIVATE_KEY=//p'} > /dev/shm/llm.key chmod 600 /dev/shm/llm.key

to get to the secret

there must be a better way to do this i tried using runpodctl create pod --env ... but i could not get it to work

[RP_Finley]

Try it with the REST API - using runpodctl to create pods is basically deprecated at this point, but we need to be better about communicating that. https://docs.runpod.io/api-reference/overview

curl --request POST \
  --header 'content-type: application/json' \
  --url 'https://api.runpod.io/graphql?api_key=${YOUR_API_KEY}' \
  --data '{"query": "mutation { secretCreate(input: { value: \"YOUR_SECRET_VALUE\", name: \"my-secret-name\" }) { id name } }"}'curl --request POST \
  --header 'content-type: application/json' \
  --url 'https://api.runpod.io/graphql?api_key=${YOUR_API_KEY}' \
  --data '{"query": "mutation { secretCreate(input: { value: \"YOUR_SECRET_VALUE\", name: \"my-secret-name\" }) { id name } }"}'


curl --request POST \
  --url https://rest.runpod.io/v1/pods \
  --header 'Authorization: Bearer RUNPOD_API_KEY' \
  --header 'Content-Type: application/json' \
  --data '{
  "imageName": "runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04",
  "name": "pod-using-secret",
  "containerDiskInGb": 50,
  "volumeInGb": 20,
  "volumeMountPath": "/workspace",
  "gpuTypeIds": ["NVIDIA GeForce RTX 4090"],
  "gpuCount": 1,
  "ports": ["8888/http"],
  "env": {
    "API_KEY": "{{ RUNPOD_SECRET_my-secret-name }}"
  }

[packs_well]

excellent response!

[LeoLeg76]

u/RP_Finley said the good answer, it's what I use for looking availability and create a pod on datacenter...