services.llama-cpp.extraFlags

Extra flags passed to llama-cpp-server.

Type

list of string

Default

[ ]

Example

[
  "-c"
  "4096"
  "-ngl"
  "32"
  "--numa"
  "numactl"
]

Declared

<nixpkgs/nixos/modules/services/misc/llama-cpp.nix>