Back to Skills

qdrant-vertical-scaling

qdrant
Updated 5 days ago
154
18
154
View on GitHub
Designdesign

About

This skill provides guidance on vertically scaling Qdrant by upgrading node resources like RAM and CPU. It's triggered by queries about insufficient resources or scaling up nodes to avoid horizontal scaling complexity. The advice covers both Qdrant Cloud console adjustments and self-hosted VM/container resizing.

Quick Install

Claude Code

Recommended
Primary
npx skills add qdrant/skills -a claude-code
Plugin CommandAlternative
/plugin add https://github.com/qdrant/skills
Git CloneAlternative
git clone https://github.com/qdrant/skills.git ~/.claude/skills/qdrant-vertical-scaling

Copy and paste this command in Claude Code to install this skill

Documentation

What to Do When Qdrant Needs to Scale Vertically

Vertical scaling means increasing CPU, RAM, or disk on existing nodes rather than adding more nodes. This is the recommended first step before considering horizontal scaling. Vertical scaling is simpler, avoids distributed system complexity, and is reversible.

  • Vertical scaling for Qdrant Cloud is done through the Qdrant Cloud Console
  • For self-hosted deployments, resize the underlying VM or container resources

When to Scale Vertically

Use when: current node resources (RAM, CPU, disk) are insufficient, but the workload doesn't yet require distribution.

  • RAM usage approaching 80% of available memory (OS page cache eviction starts, severe performance degradation)
  • CPU saturation during query serving or indexing
  • Disk space running low for on-disk vectors and payloads
  • A single node can handle up to ~100M vectors depending on dimensions and quantization
  • For non-production workloads, which are tolerant to single-point-of-failure and don't require high availability

How to Scale Vertically in Qdrant Cloud

Vertical scaling is managed through the Qdrant Cloud Console.

  • Log into Qdrant Cloud Console or use CLI tool
  • Select the cluster to resize
  • Choose a larger node configuration (more RAM, CPU, or both)
  • The upgrade process involves a rolling restart with no downtime if replication is configured
  • Ensure replication_factor: 2 or higher before resizing to maintain availability during the rolling restart

Important: Scaling up is straightforward. Scaling down requires care -- if the working set no longer fits in RAM after downsizing, performance will degrade severely due to cache eviction. Always load test before scaling down.

RAM Sizing Guidelines

RAM is the most critical resource for Qdrant performance. Use these guidelines to right-size.

  • Exact estimation of RAM usage is difficult; use this simple approximate formula: num_vectors * dimensions * 4 bytes * 1.5 for full-precision vectors in RAM
  • With scalar quantization: divide by 4 (INT8 reduces each float32 to 1 byte) Quantization
  • With binary quantization: divide by 32 Binary quantization
  • Add overhead for HNSW index (~20-30% of vector data), payload indexes, and WAL
  • Reserve 20% headroom for optimizer operations and OS cache
  • Monitor actual usage via Grafana/Prometheus before and after resizing Monitoring

When Vertical Scaling Is No Longer Enough

Recognize these signals that it's time to go horizontal:

  • Data volume exceeds what a single node can hold even with quantization and mmap
  • IOPS are saturated (more nodes = more independent disk I/O)
  • Need fault tolerance (requires replication across nodes)
  • Need tenant isolation via dedicated shards
  • Single-node CPU is maxed and query latency is unacceptable
  • Next vertical scaling step is the largest available node size. You might need to be able to temporarily scale up to the larger node size to do batch operations or recovery. If you are already at the largest node size, you won't be able to do that.

When you hit these limits, see Horizontal Scaling for guidance on sharding and node planning.

What NOT to Do

  • Do not scale down RAM without load testing first (cache eviction = severe latency degradation that can last days)
  • Do not ignore the 80% RAM threshold (performance cliff, not gradual degradation)
  • Do not skip replication before resizing in Cloud (rolling restart without replicas = downtime)
  • Do not jump to horizontal scaling before exhausting vertical options (adds permanent operational complexity)
  • Do not assume more CPU always helps (IOPS-bound workloads won't improve with more cores)

GitHub Repository

qdrant/skills
Path: skills/qdrant-scaling/scaling-data-volume/vertical-scaling
0
agent-skillsai-agentsclaude-codecodexcursorembeddings

Related Skills

executing-plans

Design

Use the executing-plans skill when you have a complete implementation plan to execute in controlled batches with review checkpoints. It loads and critically reviews the plan, then executes tasks in small batches (default 3 tasks) while reporting progress between each batch for architect review. This ensures systematic implementation with built-in quality control checkpoints.

View skill

requesting-code-review

Design

This skill dispatches a code-reviewer subagent to analyze code changes against requirements before proceeding. It should be used after completing tasks, implementing major features, or before merging to main. The review helps catch issues early by comparing the current implementation with the original plan.

View skill

connect-mcp-server

Design

This skill provides a comprehensive guide for developers to connect MCP servers to Claude Code using HTTP, stdio, or SSE transports. It covers installation, configuration, authentication, and security for integrating external services like GitHub, Notion, and custom APIs. Use it when setting up MCP integrations, configuring external tools, or working with Claude's Model Context Protocol.

View skill

web-cli-teleport

Design

This skill helps developers choose between Claude Code Web and CLI interfaces based on task analysis, then enables seamless session teleportation between these environments. It optimizes workflow by managing session state and context when switching between web, CLI, or mobile. Use it for complex projects requiring different tools at various stages.

View skill