services.ollama.acceleration

What interface to use for hardware acceleration. It is now preferred to set services.ollama.package instead.

• null: default behavior; usually equivalent to false
  • if nixpkgs.config.rocmSupport is enabled, is equivalent to "rocm"
  • if nixpkgs.config.cudaSupport is enabled, is equivalent to "cuda"
  • otherwise defaults to false
• false: disable GPU; only use CPU
• "rocm": supported by most modern AMD GPUs
  • may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn't detect your AMD gpu
• "cuda": supported by most modern NVIDIA GPUs
• "vulkan": supported by most GPUs

Type

null or one of false, "rocm", "cuda", "vulkan"

Default

null

Example

"rocm"

Declared

<nixpkgs/nixos/modules/services/misc/ollama.nix>