SKILL·6C2D43

peft-fine-tuning

davila7
Updated 2 months ago
288 views
18,478
1,685
18,478
View on GitHub
OtherFine-TuningPEFTLoRAQLoRAParameter-EfficientAdaptersLow-RankMemory OptimizationMulti-Adapter

About

This skill enables parameter-efficient fine-tuning of large language models using LoRA, QLoRA, and 25+ adapter methods, drastically reducing GPU memory requirements. It's ideal for fine-tuning 7B-70B models on consumer hardware by training less than 1% of parameters with minimal accuracy loss. The skill integrates HuggingFace's official PEFT library for multi-adapter serving and seamless use within the transformers ecosystem.

Quick Install

Claude Code

Recommended
Primary
npx skills add davila7/claude-code-templates -a claude-code
Plugin CommandAlternative
/plugin add https://github.com/davila7/claude-code-templates
Git CloneAlternative
git clone https://github.com/davila7/claude-code-templates.git ~/.claude/skills/peft-fine-tuning

Copy and paste this command in Claude Code to install this skill

GitHub Repository

davila7/claude-code-templates
Path: cli-tool/components/skills/ai-research/fine-tuning-peft
0
anthropicanthropic-claudeclaudeclaude-code
FAQ

Frequently asked questions

What is the peft-fine-tuning skill?

peft-fine-tuning is a Claude Skill by davila7. Skills package instructions and resources that Claude loads on demand, so Claude can perform peft-fine-tuning-related tasks without extra prompting.

How do I install peft-fine-tuning?

Use the install commands on this page: add peft-fine-tuning to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.

What category does peft-fine-tuning belong to?

peft-fine-tuning is in the Other category, tagged Fine-Tuning, PEFT, LoRA, QLoRA, Parameter-Efficient and Adapters.

Is peft-fine-tuning free to use?

Yes. peft-fine-tuning is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.

Related Skills

llamaguard
Other

LlamaGuard is Meta's 7-8B parameter model for moderating LLM inputs and outputs across six safety categories like violence and hate speech. It offers 94-95% accuracy and can be deployed using vLLM, Hugging Face, or Amazon SageMaker. Use this skill to easily integrate content filtering and safety guardrails into your AI applications.

View skill
cost-optimization
Other

This Claude Skill helps developers optimize cloud costs through resource rightsizing, tagging strategies, and spending analysis. It provides a framework for reducing cloud expenses and implementing cost governance across AWS, Azure, and GCP. Use it when you need to analyze infrastructure costs, right-size resources, or meet budget constraints.

View skill
sports-betting-analyzer
Other

This Claude Skill analyzes sports betting markets including spreads, over/unders, and prop bets by examining historical trends and situational statistics to identify value bets. It provides structured markdown output with actionable recommendations for educational purposes. Developers should use this for sports betting analysis tools while noting it's designed for entertainment/education only.

View skill
quantizing-models-bitsandbytes
Other

This skill quantizes LLMs to 8-bit or 4-bit precision using bitsandbytes, achieving 50-75% memory reduction with minimal accuracy loss. It's ideal for running larger models on limited GPU memory or accelerating inference, supporting formats like INT8, NF4, and FP4. The skill integrates with HuggingFace Transformers and enables QLoRA training and 8-bit optimizers.

View skill