Skills for Roo Code

A

Arize Evaluator

github

Streamline LLM evaluation workflows on Arize.

RAG Evaluation

nvidia

Evaluate retrieval-augmented generation benchmarks efficiently.

NV-Reason-CXR

nvidia

Run smoke tests for chest X-ray reasoning models.

Clinical ASR Evaluation

nvidia

Score and evaluate clinical ASR manifests effectively.

NeMo Evaluator SDK

davila7

Enterprise-grade LLM benchmarking across 100+ tasks.

LLM Evaluation Harness

davila7

Benchmark LLMs across 60+ academic tasks.

Retune a Corpus

everyinc

Optimize your skill corpus for improved model performance.

Evals

danielmiessler

An assertion-first framework for AI evaluations.

DeepEval

confident-ai

Streamline evaluation workflows for AI applications.

O

Obliteratus

nousresearch

Remove refusal behaviors from LLMs without retraining.

Hugging Face Community Evals

huggingface

Evaluate Hugging Face models locally with ease.

Agent Platform Eval Flywheel

google

Evaluate and enhance AI models on Google Cloud.

Phoenix Observability

davila7

Open-source observability for LLM applications.

i4h Workflow Validate

nvidia

Validate and evaluate i4h environments efficiently.

Ollama CLI Interface

hkuds

Manage models and generate text from the command line.

Agent Evaluation CLI

google

Efficiently evaluate and optimize your AI agents.

LLM Eval Harness

daymade

Evaluate LLM endpoints for reliability and performance.

GAIA Submission

ruvnet

Streamline your GAIA benchmark submission process.

Harness Learn

ruvnet

Optimize harness genomes with automated learning cycles.

Cost Counterfactual

ruvnet

Analyze routing costs against baseline models.

Behavioral X-Ray

sickn33

Probe AI models for hidden behavioral patterns.

AI Ethics Validator

jeremylongshore

Ensure fairness and compliance in AI models and datasets.

Promptfoo Evaluation

daymade

Efficiently evaluate LLM outputs with Promptfoo.

O

OpenClaw Model Switch

daymade

Easily manage OpenClaw model configurations.