python313Packages.exllamav2

Inference library for running LLMs locally on modern consumer-class GPUs

Name

exllamav2

Homepage

• https://github.com/turboderp-org/exllamav2

Version

0.3.2

License

• MIT License

Maintainers

• BatteredBunny

Platforms

• x86_64-windows
• x86_64-linux

Defined

Source