返回技能列表

review-data-analysis

pjt222
更新于 6 days ago
19 次查看
17
2
17
在 GitHub 上查看
测试data

关于

This skill reviews data analyses for quality, correctness, and reproducibility, covering data quality, model validation, and leakage detection. It's designed for validating ML pipelines before production, auditing reports for business decisions, or performing second-analyst reviews in regulated environments. Use it when you need a systematic check of an analysis before publication or deployment.

快速安装

Claude Code

推荐
主要方式
npx skills add pjt222/agent-almanac -a claude-code
插件命令备选方式
/plugin add https://github.com/pjt222/agent-almanac
Git 克隆备选方式
git clone https://github.com/pjt222/agent-almanac.git ~/.claude/skills/review-data-analysis

在 Claude Code 中复制并粘贴此命令以安装该技能

技能文档

審數析

評數析管之正、韌、可復。

  • 審同事析簿或本於發前
  • 驗 ML 管於生產發前
  • 審析報為規或業決
  • 估析支所述結乎
  • 行第二析審於規環

  • :析碼(本、簿、管定)
  • :析出(果、表、圖、模指)
  • :原數或數典
  • :析計或協(預登或臨)
  • :標群與決脈

一:估數質

評析前審入數:

## Data Quality Assessment

### Completeness
- [ ] Missing data quantified (% by column and by row)
- [ ] Missing data mechanism considered (MCAR, MAR, MNAR)
- [ ] Imputation method appropriate (if used) or complete-case analysis justified

### Consistency
- [ ] Data types match expectations (dates are dates, numbers are numbers)
- [ ] Value ranges are plausible (no negative ages, future dates in historical data)
- [ ] Categorical variables have expected levels (no misspellings, consistent coding)
- [ ] Units are consistent across records

### Uniqueness
- [ ] Duplicate records identified and handled
- [ ] Primary keys are unique where expected
- [ ] Join operations produce expected row counts (no fan-out or drop)

### Timeliness
- [ ] Data vintage appropriate for the analysis question
- [ ] Temporal coverage matches the study period
- [ ] No look-ahead bias in time-series data

### Provenance
- [ ] Data source documented
- [ ] Extraction date/version recorded
- [ ] Any transformations between source and analysis input documented

得:數質患書、含其對果或影。 敗:數不可審→自碼估質(何察與化施)。

二:察設

各統法或所用模:

MethodKey AssumptionsHow to Check
Linear regressionLinearity, independence, normality of residuals, homoscedasticityResidual plots, Q-Q plot, Durbin-Watson, Breusch-Pagan
Logistic regressionIndependence, no multicollinearity, linear logitVIF, Box-Tidwell, residual diagnostics
t-testIndependence, normality (or large n), equal varianceShapiro-Wilk, Levene's test, visual inspection
ANOVAIndependence, normality, homogeneity of varianceShapiro-Wilk per group, Levene's test
Chi-squaredIndependence, expected frequency ≥ 5Expected frequency table
Random forestSufficient training data, feature relevanceOOB error, feature importance, learning curves
Neural networkSufficient data, appropriate architecture, no data leakageValidation curves, overfitting checks
## Assumption Check Results
| Analysis Step | Method | Assumption | Checked? | Result |
|---------------|--------|------------|----------|--------|
| Primary model | Linear regression | Normality of residuals | Yes | Q-Q plot shows mild deviation — acceptable for n>100 |
| Primary model | Linear regression | Homoscedasticity | No | Not checked — recommend adding Breusch-Pagan test |

得:各統法之設明察或認。 敗:設違→察作者處之乎(韌法、化、敏析)。

三:察數漏

數漏即訓集外訊影模、致過樂效:

常漏模:

  • 標漏:直編標變之徵(如「treatment_outcome」用以測「treatment_success」)
  • 時漏:未來訊用以測過(自測時不可得之數計徵)
  • 訓測污:預處(縮、補、徵選)於分前合全集
  • 群漏:相關察(同患、同器)跨訓測分
  • 徵工漏:聚於整集計、非於訓折內
## Leakage Assessment
| Check | Status | Evidence |
|-------|--------|----------|
| Target leakage | Clear | No features derived from target |
| Temporal leakage | CONCERN | Feature X uses 30-day forward average |
| Train-test contamination | Clear | StandardScaler fit on train only |
| Group leakage | CONCERN | Patient IDs not used for stratified split |

得:諸常漏模察含潔/憂態。 敗:漏發見→重行無漏徵估其影(若可)或標令析者察。

四:驗模效

為測模:

  • 應問之正指(非僅準——考精、召、F1、AUC、RMSE、MAE)
  • 交驗或留策述且應
  • 訓對測/驗集效較(過擬察)
  • 基較(樸模、隨機、前法)
  • 效指之信區或標誤
  • 相子群效估(公、邊例)

為推/釋模:

  • 模合統報(R²、AIC、BIC、deviance)
  • 系正釋(向、量、義)
  • 多共線估(VIF < 5–10)
  • 影察識(Cook 距、leverage)
  • 多規測時模較

得:模驗應用例(測對推)。 敗:測集效疑近訓效→標潛漏。

五:估可復

## Reproducibility Checklist
| Item | Status | Notes |
|------|--------|-------|
| Code runs without errors | [Yes/No] | Tested on [environment description] |
| Random seeds set | [Yes/No] | Line [N] in [file] |
| Dependencies documented | [Yes/No] | requirements.txt / renv.lock present |
| Data loading reproducible | [Yes/No] | Path is [relative/absolute/URL] |
| Results match reported values | [Yes/No] | Verified: Table 1 ✓, Figure 2 ✗ (minor discrepancy) |
| Environment documented | [Yes/No] | Python 3.11 / R 4.5.0 specified |

得:可復重行析驗(或數無時自碼估)。 敗:果不確復→定異於浮容內乎抑示問。

六:書審

## Data Analysis Review

### Overall Assessment
[1-2 sentences: Is the analysis sound? Does it support the conclusions?]

### Data Quality
[Summary of data quality findings, impact on results]

### Methodological Concerns
1. **[Title]**: [Description, location in code/report, suggestion]
2. ...

### Strengths
1. [What was done well]
2. ...

### Reproducibility
[Tier assessment: Gold/Silver/Bronze/Opaque with justification]

### Recommendations
- [ ] [Specific action items for the analyst]

得:審供可動饋含特碼處引。 敗:時限→質與漏察優於格患。

  • 數質跨完、恆、唯、時、源估
  • 各所用法統設察
  • 數漏系估
  • 模效以應指與基驗
  • 可復估(碼行、果合)
  • 饋特、引碼行或報段
  • 調建設且協

  • 唯審碼:析計與結與實同要
  • 忽數質:壞數上精模生信誤答
  • 由複設正:95% 準隨機林或有數漏;簡 t 或為正法
  • 不行碼:可則行碼以驗可復。讀碼不足
  • 失林為樹:勿迷碼格患而失基析誤

  • review-research — 廣研法與稿審
  • validate-statistical-output — 雙程驗法
  • generate-statistical-tables — 發備統表
  • review-software-architecture — 碼構與設審

GitHub 仓库

pjt222/agent-almanac
路径: i18n/wenyan-ultra/skills/review-data-analysis
0
agentsagentskillsai-assisted-developmentclaude-codeskillsteams

相关推荐技能

evaluating-llms-harness

测试

该Skill通过60+个学术基准测试(如MMLU、GSM8K等)评估大语言模型质量,适用于模型对比、学术研究及训练进度追踪。它支持HuggingFace、vLLM和API接口,被EleutherAI等行业领先机构广泛采用。开发者可通过简单命令行快速对模型进行多任务批量评估。

查看技能

cloudflare-cron-triggers

测试

这个Claude Skill提供了关于Cloudflare Cron Triggers的完整知识库,用于通过cron表达式定时执行Workers。它支持配置周期性任务、维护作业和自动化工作流,并能处理常见的cron触发错误。开发者可以用它来设置定时任务、测试cron处理器,并集成Workflows和Green Compute功能。

查看技能

webapp-testing

测试

该Skill为开发者提供了基于Playwright的本地Web应用测试工具集,支持自动化测试前端功能、调试UI行为、捕获屏幕截图和查看浏览器日志。它包含管理服务器生命周期的辅助脚本,可直接作为黑盒工具运行而无需阅读源码。适用于需要快速验证本地Web应用界面和交互功能的开发场景。

查看技能

finishing-a-development-branch

测试

这个Skill用于开发分支完成后的集成决策,当代码实现完成且测试通过时,它会引导开发者选择合适的工作流。它首先验证测试状态,然后提供合并、创建PR或清理等结构化选项。核心价值在于确保代码质量的同时,标准化分支收尾流程。

查看技能