services.ollama.package

The ollama package to use. Different packages use different hardware acceleration.

• ollama: default behavior; usually equivalent to ollama-cpu
  • if nixpkgs.config.rocmSupport is enabled, is equivalent to ollama-rocm
  • if nixpkgs.config.cudaSupport is enabled, is equivalent to ollama-cuda
  • otherwise defaults to ollama-cpu
• ollama-cpu: disable GPU; only use CPU
• ollama-rocm: supported by most modern AMD GPUs
  • may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn't detect your AMD gpu
• ollama-cuda: supported by most modern NVIDIA GPUs
• ollama-vulkan: supported by most GPUs

Type

package

Default

pkgs.ollama

Example

pkgs.ollama-rocm

Declared

<nixpkgs/nixos/modules/services/misc/ollama.nix>