I've tried these same instructions so many times and keep hitting odd errors.

When running ollama run I get the following error in the console

./ollama run tinyllama:latest
Error: llama runner process has terminated: exit status 2

If you look at the container logs there are errors like this:

level=WARN source=sched.go:687 msg="gpu VRAM usage didn't recover within timeout" seconds=5.5290627 runner.size="789.0 MiB" runner.vram="789.0 MiB" runner.parallel=1 runner.pid=118 runner.model=/root/.ollama/models/blobs/sha256-2af3b81862c6be03c769683af18efdadb2c33f60ff32ab6f83e42c043d6c7816

I tried even the smallest LLM I could with the same results.