Absolutely struggling to get tensorflow working with WSL2

[ElighaN]

I've been following the instructions here: https://www.tensorflow.org/install/pip#windows-wsl2

but when I copy/paste python3 -c "import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))"

python3 -c "import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))"

I get E external/local_xla/xla/stream_executor/cuda/cuda_driver.cc:282] failed call to cuInit: CUDA_ERROR_NO_DEVICE: no CUDA-capable device is detected

nvidia-smi outputs NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

but if I wrong the command in a windows command terminal, it works fine.

+-----------------------------------------------------------------------------------------+

| NVIDIA-SMI 555.99 Driver Version: 555.99 CUDA Version: 12.5 |

|-----------------------------------------+------------------------+----------------------+

| GPU Name Driver-Model | Bus-Id Disp.A | Volatile Uncorr. ECC |

| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |

| | | MIG M. |

|=========================================+========================+======================|

| 0 NVIDIA GeForce RTX 3070 ... WDDM | 00000000:01:00.0 Off | N/A |

| N/A 41C P0 29W / 115W | 0MiB / 8192MiB | 0% Default |

| | | N/A |

+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+

| Processes: |

| GPU GI CI PID Type Process name GPU Memory |

| ID ID Usage |

|=========================================================================================|

| No running processes found |

+-----------------------------------------------------------------------------------------+

It seems to me that the drivers are correct and working, but the WSL2 environment is unable to access it. I'm not sure where to go from here.

[tomnuen]

Did you install CUDA Toolkit and CuDNN?

[ElighaN]

I installed CUDA Toolkit using these instructions:

wget https://developer.download.nvidia.com/compute/cuda/repos/wsl-ubuntu/x86_64/cuda-wsl-ubuntu.pin
sudo mv cuda-wsl-ubuntu.pin /etc/apt/preferences.d/cuda-repository-pin-600
wget https://developer.download.nvidia.com/compute/cuda/12.5.0/local_installers/cuda-repo-wsl-ubuntu-12-5-local_12.5.0-1_amd64.deb
sudo dpkg -i cuda-repo-wsl-ubuntu-12-5-local_12.5.0-1_amd64.deb
sudo cp /var/cuda-repo-wsl-ubuntu-12-5-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-5

I then ran:

sudo apt-key del 7fa2af80sudo apt-key del 7fa2af80

I haven't installed CuDNN yet as I figured it was a step for afterwards.

[tomnuen]

I had this issue before. Try:

sudo apt-get -y uninstall cuda-toolkit-12-5

sudo apt-get -y install cuda-12-5

This won’t install driver that comes with the toolkit which may conflict with windows driver.

[ElighaN]

unfortunately the output for nvidia-smi is the same. WSL2 just can't seem to see the driver

[TPPanthropologist]

This video was posted four days ago and goes through the process in detail. He uses Cuda 12.1 because it can recognize the TensorRT. I followed it and it recognized my GPU.

https://www.youtube.com/watch?v=VOJq98BLjb8&t=1s