python313Packages.exllamav3

Quantization and inference library for running LLMs locally on modern consumer-class GPUs

Name

exllamav3

Homepage

• https://github.com/turboderp-org/exllamav3

Version

0.0.20

License

• MIT License

Maintainers

• BatteredBunny

Platforms

• x86_64-windows
• x86_64-linux

Defined

Source