services.ollama.package
The ollama package to use. Different packages use different hardware acceleration.
ollama: default behavior; usually equivalent toollama-cpu- if
nixpkgs.config.rocmSupportis enabled, is equivalent toollama-rocm - if
nixpkgs.config.cudaSupportis enabled, is equivalent toollama-cuda - otherwise defaults to
ollama-cpu
- if
ollama-cpu: disable GPU; only use CPUollama-rocm: supported by most modern AMD GPUs- may require overriding gpu type with
services.ollama.rocmOverrideGfxif rocm doesn't detect your AMD gpu
- may require overriding gpu type with
ollama-cuda: supported by most modern NVIDIA GPUsollama-vulkan: supported by most GPUs
- Type
package- Default
pkgs.ollama- Example
pkgs.ollama-rocm- Declared
- <nixpkgs/nixos/modules/services/misc/ollama.nix>