About
This skill assists with scalable data pipeline development, ETL/ELT implementation, and data infrastructure design. It provides expertise in technologies like Airflow, dbt, Spark, and Kafka for building reliable data lakes, warehouses, and stream processing systems. Use it for tasks involving data workflow optimization, cost management, and modern data stack migrations.
Quick Install
Claude Code
Recommendednpx skills add majiayu000/claude-skill-registry -a claude-code/plugin add https://github.com/majiayu000/claude-skill-registrygit clone https://github.com/majiayu000/claude-skill-registry.git ~/.claude/skills/data-engineerCopy and paste this command in Claude Code to install this skill
GitHub Repository
Frequently asked questions
What is the data-engineer skill?
data-engineer is a Claude Skill by majiayu000. Skills package instructions and resources that Claude loads on demand, so Claude can perform data-engineer-related tasks without extra prompting.
How do I install data-engineer?
Use the install commands on this page: add data-engineer to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.
What category does data-engineer belong to?
data-engineer is in the Design category, tagged design and data.
Is data-engineer free to use?
Yes. data-engineer is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.
Related Skills
Use the executing-plans skill when you have a complete implementation plan to execute in controlled batches with review checkpoints. It loads and critically reviews the plan, then executes tasks in small batches (default 3 tasks) while reporting progress between each batch for architect review. This ensures systematic implementation with built-in quality control checkpoints.
This skill dispatches a code-reviewer subagent to analyze code changes against requirements before proceeding. It should be used after completing tasks, implementing major features, or before merging to main. The review helps catch issues early by comparing the current implementation with the original plan.
This skill provides a comprehensive guide for developers to connect MCP servers to Claude Code using HTTP, stdio, or SSE transports. It covers installation, configuration, authentication, and security for integrating external services like GitHub, Notion, and custom APIs. Use it when setting up MCP integrations, configuring external tools, or working with Claude's Model Context Protocol.
This skill helps developers choose between Claude Code Web and CLI interfaces based on task analysis, then enables seamless session teleportation between these environments. It optimizes workflow by managing session state and context when switching between web, CLI, or mobile. Use it for complex projects requiring different tools at various stages.