services.ollama.acceleration

What interface to use for hardware acceleration.

• null: default behavior
  • if nixpkgs.config.rocmSupport is enabled, uses "rocm"
  • if nixpkgs.config.cudaSupport is enabled, uses "cuda"
  • otherwise defaults to false
• false: disable GPU, only use CPU
• "rocm": supported by most modern AMD GPUs
  • may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn't detect your AMD gpu
• "cuda": supported by most modern NVIDIA GPUs

Type

null or one of false, "rocm", "cuda"

Default

null

Example

"rocm"

Declared

<home-manager/modules/services/ollama.nix>