evaluating-llms-harness
关于
This skill runs standardized LLM evaluations across 60+ academic benchmarks like MMLU and GSM8K using the industry-standard lm-evaluation-harness. Use it for benchmarking model quality, comparing different models, or tracking training progress with support for HuggingFace, vLLM, and API-based models. It provides a consistent, widely-adopted method for reporting academic results.
快速安装
Claude Code
推荐npx skills add davila7/claude-code-templates -a claude-code/plugin add https://github.com/davila7/claude-code-templatesgit clone https://github.com/davila7/claude-code-templates.git ~/.claude/skills/evaluating-llms-harness在 Claude Code 中复制并粘贴此命令以安装该技能
GitHub 仓库
Frequently asked questions
What is the evaluating-llms-harness skill?
evaluating-llms-harness is a Claude Skill by davila7. Skills package instructions and resources that Claude loads on demand, so Claude can perform evaluating-llms-harness-related tasks without extra prompting.
How do I install evaluating-llms-harness?
Use the install commands on this page: add evaluating-llms-harness to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.
What category does evaluating-llms-harness belong to?
evaluating-llms-harness is in the Testing category, tagged Evaluation, LM Evaluation Harness, Benchmarking, MMLU, HumanEval and GSM8K.
Is evaluating-llms-harness free to use?
Yes. evaluating-llms-harness is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.
相关推荐技能
该Skill通过60+个学术基准测试（如MMLU、GSM8K等）评估大语言模型质量，适用于模型对比、学术研究及训练进度追踪。它支持HuggingFace、vLLM和API接口，被EleutherAI等行业领先机构广泛采用。开发者可通过简单命令行快速对模型进行多任务批量评估。
这个Claude Skill提供了关于Cloudflare Cron Triggers的完整知识库，用于通过cron表达式定时执行Workers。它支持配置周期性任务、维护作业和自动化工作流，并能处理常见的cron触发错误。开发者可以用它来设置定时任务、测试cron处理器，并集成Workflows和Green Compute功能。
该Skill为开发者提供了基于Playwright的本地Web应用测试工具集，支持自动化测试前端功能、调试UI行为、捕获屏幕截图和查看浏览器日志。它包含管理服务器生命周期的辅助脚本，可直接作为黑盒工具运行而无需阅读源码。适用于需要快速验证本地Web应用界面和交互功能的开发场景。
这个Skill用于开发分支完成后的集成决策，当代码实现完成且测试通过时，它会引导开发者选择合适的工作流。它首先验证测试状态，然后提供合并、创建PR或清理等结构化选项。核心价值在于确保代码质量的同时，标准化分支收尾流程。