4 Bit skills
Free agent skills tagged 4 bit, ready to install into any SKILL.md-compatible agent.
3 skills
GPTQ Quantization
davila7
Efficiently deploy large LLMs on consumer GPUs with minimal loss.
Developer ToolsintermediatePython · Shell30.2k repo
B
BitsAndBytes Quantization
davila7
Optimize LLMs with efficient quantization techniques.
Developer ToolsintermediatePython · Shell30.2k repo
A
AWQ Quantization
davila7
Optimize large models with 4-bit quantization.
Developer ToolsintermediatePython · Shell30.2k repo