gguf-quantization
About
This skill enables GGUF quantization for efficient model deployment on consumer hardware like CPUs and Apple Silicon. It provides flexible 2-8 bit quantization options without requiring GPU acceleration. Use it when optimizing models for local inference tools or resource-constrained environments.
Quick Install
Claude Code
Recommendednpx skills add davila7/claude-code-templates -a claude-code/plugin add https://github.com/davila7/claude-code-templatesgit clone https://github.com/davila7/claude-code-templates.git ~/.claude/skills/gguf-quantizationCopy and paste this command in Claude Code to install this skill
GitHub Repository
Frequently asked questions
What is the gguf-quantization skill?
gguf-quantization is a Claude Skill by davila7. Skills package instructions and resources that Claude loads on demand, so Claude can perform gguf-quantization-related tasks without extra prompting.
How do I install gguf-quantization?
Use the install commands on this page: add gguf-quantization to Claude Code as a plugin, or clone its repository into your skills directory, then restart Claude so it picks up the skill.
What category does gguf-quantization belong to?
gguf-quantization is in the Design category, tagged GGUF, Quantization, llama.cpp, CPU Inference, Apple Silicon and Model Compression.
Is gguf-quantization free to use?
Yes. gguf-quantization is listed on AIMCP and free to install. It runs inside Claude, so no separate service account is required to use the skill itself.
Related Skills
Use the executing-plans skill when you have a complete implementation plan to execute in controlled batches with review checkpoints. It loads and critically reviews the plan, then executes tasks in small batches (default 3 tasks) while reporting progress between each batch for architect review. This ensures systematic implementation with built-in quality control checkpoints.
This skill dispatches a code-reviewer subagent to analyze code changes against requirements before proceeding. It should be used after completing tasks, implementing major features, or before merging to main. The review helps catch issues early by comparing the current implementation with the original plan.
This skill provides a comprehensive guide for developers to connect MCP servers to Claude Code using HTTP, stdio, or SSE transports. It covers installation, configuration, authentication, and security for integrating external services like GitHub, Notion, and custom APIs. Use it when setting up MCP integrations, configuring external tools, or working with Claude's Model Context Protocol.
This skill helps developers choose between Claude Code Web and CLI interfaces based on task analysis, then enables seamless session teleportation between these environments. It optimizes workflow by managing session state and context when switching between web, CLI, or mobile. Use it for complex projects requiring different tools at various stages.