Llama Cpp skills

Llama.cpp Inference

nousresearch

Run local GGUF inference and discover Hugging Face models.

GGUF Quantization

davila7

Efficient model deployment for consumer hardware.

Llama.cpp

davila7

Efficient LLM inference on non-NVIDIA hardware.

Jetson LLM Benchmark

nvidia

Benchmark LLM performance on Jetson devices with JSON output.

Hugging Face Local Models

huggingface

Run models locally with llama.cpp and GGUF.