eval-driven-dev
About
This skill provides a complete eval-driven development pipeline for Python LLM applications, enabling developers to instrument their code, build test datasets, and run evaluations to catch regressions and debug issues. It automatically handles the full testing cycle from writing eval-based tests to root-causing failures when prompts or agent behavior changes. Use it whenever developing, testing, or benchmarking any Python project that calls an LLM to ensure output quality and prevent regressions.
Quick Install
Claude Code
Recommendednpx skills add github/awesome-copilot -a claude-code/plugin add https://github.com/github/awesome-copilotgit clone https://github.com/github/awesome-copilot.git ~/.claude/skills/eval-driven-devCopy and paste this command in Claude Code to install this skill
GitHub Repository
Frequently asked questions
What is the eval-driven-dev skill?
eval-driven-dev is a Claude Skill by github. Skills package instructions and resources that Claude loads on demand, so Claude can perform eval-driven-dev-related tasks without extra prompting.
How do I install eval-driven-dev?
Use the install commands on this page: add eval-driven-dev to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.
What category does eval-driven-dev belong to?
eval-driven-dev is in the Meta category, tagged ai, testing, design and data.
Is eval-driven-dev free to use?
Yes. eval-driven-dev is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.
Related Skills
This skill provides a production-tested setup for Content Collections, a TypeScript-first tool that transforms Markdown/MDX files into type-safe data collections with Zod validation. Use it when building blogs, documentation sites, or content-heavy Vite + React applications to ensure type safety and automatic content validation. It covers everything from Vite plugin configuration and MDX compilation to deployment optimization and schema validation.
This skill enables developers to build applications with the Polymarket prediction markets platform, including API integration for trading and market data. It also provides real-time data streaming via WebSocket to monitor live trades and market activity. Use it for implementing trading strategies or creating tools that process live market updates.
This skill helps developers create OpenCode plugins that hook into 25+ event types like commands, files, and LSP operations. It provides the plugin structure, event API specifications, and implementation patterns for JavaScript/TypeScript modules. Use it when you need to intercept, monitor, or extend the OpenCode AI assistant's lifecycle with custom event-driven logic.
SGLang is a high-performance LLM serving framework that specializes in fast, structured generation for JSON, regex, and agentic workflows using its RadixAttention prefix caching. It delivers significantly faster inference, especially for tasks with repeated prefixes, making it ideal for complex, structured outputs and multi-turn conversations. Choose SGLang over alternatives like vLLM when you need constrained decoding or are building applications with extensive prefix sharing.
