SKILL·91BB61

data-pipeline-engineer

majiayu000
Updated 1 month ago
19 views
58
9
58
View on GitHub
Otheretlsparkkafkaairflowdata-warehouse

About

This skill provides expert data engineering for building and managing ETL/ELT pipelines, streaming systems, and data warehouses. It handles tools like Spark, Kafka, Airflow, and dbt for data modeling, processing, and quality. Use it for pipeline architecture and implementation, not for API design, ML training, or dashboard creation.

Quick Install

Claude Code

Recommended
Primary
npx skills add majiayu000/claude-skill-registry -a claude-code
Plugin CommandAlternative
/plugin add https://github.com/majiayu000/claude-skill-registry
Git CloneAlternative
git clone https://github.com/majiayu000/claude-skill-registry.git ~/.claude/skills/data-pipeline-engineer

Copy and paste this command in Claude Code to install this skill

GitHub Repository

majiayu000/claude-skill-registry
Path: skills/data/data-pipeline-engineer
0
FAQ

Frequently asked questions

What is the data-pipeline-engineer skill?

data-pipeline-engineer is a Claude Skill by majiayu000. Skills package instructions and resources that Claude loads on demand, so Claude can perform data-pipeline-engineer-related tasks without extra prompting.

How do I install data-pipeline-engineer?

Use the install commands on this page: add data-pipeline-engineer to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.

What category does data-pipeline-engineer belong to?

data-pipeline-engineer is in the Data & Analytics category, tagged etl, spark, kafka, airflow and data-warehouse.

Is data-pipeline-engineer free to use?

Yes. data-pipeline-engineer is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.

Related Skills

data-pipeline-engineer
Other

This skill provides expert data engineering for building and optimizing ETL/ELT pipelines, streaming systems (Spark/Kafka), and data warehouses. Use it for data modeling, workflow orchestration (Airflow/dbt), batch/stream processing, and ensuring data quality. It specifically excludes API design, ML training, and dashboard development, which require other specialized skills.

View skill
chatbot-analytics
Other

This skill implements AI chatbot analytics and conversation monitoring for tracking key metrics like session data, token usage, and user engagement. It's designed for developers building conversation dashboards or measuring AI chat performance while maintaining compliance standards. The skill provides tools for conversation categorization, analytics implementation, and monitoring HIPAA-safe metrics.

View skill
chatbot-analytics
Other

This skill implements AI chatbot analytics and conversation monitoring for tracking usage metrics, user engagement, and chat performance. It helps developers add conversation dashboards, monitor token usage, and categorize conversations while maintaining HIPAA compliance. Use it when building analytics features for AI chatbots or measuring conversation metrics.

View skill
content-collections
Meta

This skill provides a production-tested setup for Content Collections, a TypeScript-first tool that transforms Markdown/MDX files into type-safe data collections with Zod validation. Use it when building blogs, documentation sites, or content-heavy Vite + React applications to ensure type safety and automatic content validation. It covers everything from Vite plugin configuration and MDX compilation to deployment optimization and schema validation.

View skill