I'm building a NixOS PC specifically for AI use, and a FreeBSD NAS

[Belfry]

@techman

Support ? I dunno I didn’t ask, I just spent the last 10 days learning and breaking NixOS, and all today fighting the bloody $@$#@5@y4!!@! ‘secure-computing’ defaut ON option hidden in the advanced–>Windows–>Secure-computing bios setting. Grrr.

Ohhhhhh, nooooooo. It sounds like you were stuck in the same cyclical hell as I was in the $500[ish] AI Build Challenge thread…

@Belfry

I’ll also note for anyone going down this route - save yourself going slightly mad going around in circles with unrelated and nondescript errors when trying to get the CUDA kernel modules running for that card - disable Secure Boot .

Glad you got it working. If it was the same series of errors about kernel modules not loading that I was getting, then it was not at all intuitive to sort out!

(Proposed new tagline for HLB - “Disable Secure Boot for CUDA - just trust us”).

@techman

Then it just worked with the three commands below:

• ollama-cuda
• services.xserver.videoDrivers = [ “nvidia” ];
• hardware.nvidia.open = true;

That’s it!

Awesome! Thank you! I’ve got a bit of time off again in August, and revisiting the dual card AI build and NixOS has just been added to the list of things to get done!