What kernel are you running, @techman?
I’ve had nothing but trouble trying to get CUDA running on my machine today under NixOS.
I seem to be continually bumping up against CUDA error: no kernel image is available for execution on the device in ollama. It loads fine in CPU mode, but crashes out with that error when it tries to push layers to the GPU.
Card is detected fine, and nvidia-smi reports Driver Version: 570.153.02 and CUDA Version: 12.8 - exactly the same as your screenshots earlier in the thread. I feel as if I’m missing something really obvious. I’m running kernel 6.12.39 which came with NixOS installed earlier today. Did you need to install kernel headers or anything like that?
(Yes, Secure Boot is DEFINITELY turned off 
).