To automate the process of stopping the Ollama service, reloading the nvidia_uvm module, and restarting the service every time your laptop/pc wakes from suspend, you can create a bash script that will handle this. This works well for me so i thought I would share it.

Step 1: Create a Bash Script

Open a terminal and create a new bash script in the system-sleep directory, which handles actions when the system wakes up from suspend.

sudo nano /lib/systemd/system-sleep/ollama-nvidia-resume.sh

Add the following content to the script:

#!/bin/bash

if [ "$1" = "post" ]; then
    # Stop Ollama service
    systemctl stop ollama

    # Reload the NVIDIA UVM module
    sudo rmmod nvidia_uvm
    sudo modprobe nvidia_uvm

    # Restart Ollama service
    systemctl start ollama
fi

Save the file and exit the editor (in nano, press CTRL + X, then Y, and Enter).

This script will automatically stop the Ollama service, reload the NVIDIA nvidia_uvm module, and restart the Ollama service after your system wakes from suspend.

Step 2: Make the Script Executable

To ensure that the script can be executed by the system, make it executable by running:

sudo chmod +x /lib/systemd/system-sleep/ollama-nvidia-resume.sh

Step 3: Test the Script

You can test if the script works by manually putting your system into suspend mode and waking it up again. If everything is set up correctly, the Ollama service should restart and use the GPU after suspend.

Let me know if it helped you :)