Evaluation skills

E

Eval-Driven Development

github

Automate evaluation for Python LLM applications.

PyTDC

k-dense-ai

Access and evaluate therapeutic datasets with PyTDC.

PAIDF AnomalyGen

nvidia

Generate and evaluate synthetic anomaly images efficiently.

DINO Object Detection

nvidia

Train and deploy 2D object detection models with DINO.

RAG Evaluation

nvidia

Evaluate retrieval-augmented generation benchmarks efficiently.

Code Model Evaluation

davila7

Benchmark code generation models across multiple tasks.

Phoenix Observability

davila7

Open-source observability for LLM applications.

N

Nemotron Customize

nvidia

Streamline your model customization workflows with ease.

i4h Workflow Validate

nvidia

Validate and evaluate i4h environments efficiently.

A

AI Engineering Toolkit

sickn33

Transform your AI coding assistant into a senior engineering partner.

Create Instance AI Workflow Eval

n8n-io

Efficiently author and manage AI workflow evaluations.

Benchmark Harness

mims-harvard

Enhance ToolUniverse tools with systematic evaluation.

Cosmos Policy Evaluation

orchestra-research

Evaluate NVIDIA Cosmos Policy in simulation environments.

Benchmark Sandbox

vercel

Run Vercel plugin evaluations in isolated environments.

S

Skill Creator

feiskyer

Build and refine AI agent skills efficiently.