About this Skill
Practical workflows for assessing and improving product-specific LLM evaluations.
Why we picked it
A focused audit of product evaluation artifacts, including judge validation against human labels.
Skills in this collection
1 skills- View →
Eval Audit
Audit an LLM evaluation pipeline for missing error analysis, unvalidated judges, data leakage and stale checks.
What it helps with
- Review an existing LLM evaluation system and prioritize evidence-backed improvements.
Before you use it
- Provide evaluation traces, judge prompts, labeled data or other pipeline artifacts; an observability integration is optional.
Sources & references
Original sources are linked below. Practical starting points are editorial suggestions from SkillHey.