services.tabby.acceleration ‐ NixOS ‐ Searchix

services.tabby.acceleration

Specifies the device to use for hardware acceleration.

cpu: no acceleration just use the CPU
rocm: supported by modern AMD GPUs
cuda: supported by modern NVIDIA GPUs
metal: supported on darwin aarch64 machines

Tabby will try and determine what type of acceleration that is already enabled in your configuration when acceleration = null.

nixpkgs.config.cudaSupport
nixpkgs.config.rocmSupport
if stdenv.hostPlatform.isDarwin && stdenv.hostPlatform.isAarch64

IFF multiple acceleration methods are found to be enabled or if you haven't set either cudaSupport or rocmSupport you will have to specify the device type manually here otherwise it will default to the first from the list above or to cpu.

Type

null or one of "cpu", "rocm", "cuda", "metal"

Default

null

Example

"rocm"

Declared