SKILL·B3B10E

training-llms-megatron

davila7
Updated 2 months ago
322 views
18,478
1,685
18,478
View on GitHub
DesignMegatron-CoreLarge-Scale TrainingNVIDIATensor ParallelismPipeline ParallelismModel ParallelismH100Distributed TrainingProduction

About

This skill trains massive LLMs (2B-462B parameters) using NVIDIA's Megatron-Core framework for maximum GPU efficiency. Use it when training models over 1B parameters and needing advanced parallelism like tensor, pipeline, or expert parallelism. It's a production-ready framework proven on models like Nemotron and LLaMA.

Quick Install

Claude Code

Recommended
Primary
npx skills add davila7/claude-code-templates -a claude-code
Plugin CommandAlternative
/plugin add https://github.com/davila7/claude-code-templates
Git CloneAlternative
git clone https://github.com/davila7/claude-code-templates.git ~/.claude/skills/training-llms-megatron

Copy and paste this command in Claude Code to install this skill

GitHub Repository

davila7/claude-code-templates
Path: cli-tool/components/skills/ai-research/distributed-training-megatron-core
0
anthropicanthropic-claudeclaudeclaude-code
FAQ

Frequently asked questions

What is the training-llms-megatron skill?

training-llms-megatron is a Claude Skill by davila7. Skills package instructions and resources that Claude loads on demand, so Claude can perform training-llms-megatron-related tasks without extra prompting.

How do I install training-llms-megatron?

Use the install commands on this page: add training-llms-megatron to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.

What category does training-llms-megatron belong to?

training-llms-megatron is in the Design category, tagged Megatron-Core, Large-Scale Training, NVIDIA, Tensor Parallelism, Pipeline Parallelism and Model Parallelism.

Is training-llms-megatron free to use?

Yes. training-llms-megatron is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.

Related Skills

executing-plans
Design

Use the executing-plans skill when you have a complete implementation plan to execute in controlled batches with review checkpoints. It loads and critically reviews the plan, then executes tasks in small batches (default 3 tasks) while reporting progress between each batch for architect review. This ensures systematic implementation with built-in quality control checkpoints.

View skill
requesting-code-review
Design

This skill dispatches a code-reviewer subagent to analyze code changes against requirements before proceeding. It should be used after completing tasks, implementing major features, or before merging to main. The review helps catch issues early by comparing the current implementation with the original plan.

View skill
connect-mcp-server
Design

This skill provides a comprehensive guide for developers to connect MCP servers to Claude Code using HTTP, stdio, or SSE transports. It covers installation, configuration, authentication, and security for integrating external services like GitHub, Notion, and custom APIs. Use it when setting up MCP integrations, configuring external tools, or working with Claude's Model Context Protocol.

View skill
web-cli-teleport
Design

This skill helps developers choose between Claude Code Web and CLI interfaces based on task analysis, then enables seamless session teleportation between these environments. It optimizes workflow by managing session state and context when switching between web, CLI, or mobile. Use it for complex projects requiring different tools at various stages.

View skill