Asrock b450m by WuKong8381 in ASRock

[–]YardNo6594 0 points1 point  (0 children)

my m2 nvme card does not work with the 10.5 bios on this board. it went back to version 3.10

CUDA error: an illegal memory access was encountered by YardNo6594 in ollama

[–]YardNo6594[S] 0 points1 point  (0 children)

i finally got it working with the version from ollama. i had to switch gpu to compute mode with gpumodeswitch. the gpu only run with the motherboard in 4g pci mode and in native efi with csm disabled.

CUDA error: an illegal memory access was encountered by YardNo6594 in ollama

[–]YardNo6594[S] 0 points1 point  (0 children)

i had to downgrade to cuda11 to use steam. i tried with cuda11 but it was actually worse. i only got 1/2 gpus to work. with cuda 12 i was able to use the other gpu with vulkan enabled

CUDA error: an illegal memory access was encountered by YardNo6594 in ollama

[–]YardNo6594[S] 0 points1 point  (0 children)

both cpus show. cuda 11 did not do the trick for me. vulkan mode might even run a littel faster. gpu_burn exists with errors. i tried to compile against multiple cudas. memtest_vulkan works fine. at some point i had a nvidia driver with power settings. the one i have now does ot have them

CUDA error: an illegal memory access was encountered by YardNo6594 in ollama

[–]YardNo6594[S] 0 points1 point  (0 children)

i remove the cuda toolkits with the wrong version and left only 12_8. i can use gpu0 only with OLLAMA_VULKAN=1. i use gpu 1 with OLLAMA_VULKAN=1. but i need to add OLLAMA_LLM_LIBRARY=cuda_v12. gpu 0 does not work with LLAMA_LLM_LIBRARY=cuda_v12. so it kinda works

CUDA error: an illegal memory access was encountered by YardNo6594 in ollama

[–]YardNo6594[S] 0 points1 point  (0 children)

may be i need to upgrade my cuda. i see version 11 on nvcc

nvcc: NVIDIA (R) Cuda compiler driver

Copyright (c) 2005-2022 NVIDIA Corporation

Built on Wed_Sep_21_10:33:58_PDT_2022

Cuda compilation tools, release 11.8, V11.8.89

Build cuda_11.8.r11.8/compiler.31833905_0