MCP HubMCP Hub
스킬 목록으로 돌아가기

qdrant-model-migration

qdrant
업데이트됨 5 days ago
154
18
154
GitHub에서 보기
테스팅testingdesigndata

정보

이 스킬은 Qdrant에서 임베딩 모델을 마이그레이션할 때(예: 공급자 전환 또는 A/B 테스트 시) 무중단 전략을 제공합니다. 서로 다른 모델의 벡터는 호환되지 않으므로, 새로운 컬렉션을 생성하고 데이터를 재임베딩해야 함을 설명합니다. 본 가이드는 컬렉션 별칭을 사용하여 원활한 전환을 관리하는 방법을 다룹니다.

빠른 설치

Claude Code

추천
기본
npx skills add qdrant/skills -a claude-code
플러그인 명령대체
/plugin add https://github.com/qdrant/skills
Git 클론대체
git clone https://github.com/qdrant/skills.git ~/.claude/skills/qdrant-model-migration

Claude Code에서 이 명령을 복사하여 붙여넣어 스킬을 설치하세요

문서

What to Do When Changing Embedding Models

Vectors from different models are incompatible. You cannot mix old and new embeddings in the same vector space. All named vectors must be defined at collection creation time. Both migration strategies below require creating a new collection.

Can I Avoid Re-embedding?

Use when: looking for shortcuts before committing to full migration.

You MUST re-embed if: changing model provider (OpenAI to Cohere), changing architecture (CLIP to BGE), incompatible dimension counts across different models, or adding sparse vectors to dense-only collection.

You CAN avoid re-embedding if: using Matryoshka models (use dimensions parameter to output lower-dimensional embeddings, learn linear transformation from sample data, some recall loss, good for 100M+ datasets). Or changing quantization (binary to scalar): Qdrant re-quantizes automatically. Quantization

Need Zero Downtime

Use when: production must stay available. Recommended for model replacement at scale.

  • If the cluster is v1.18 or later AND the collection has named vectors:

    • Add the new vector field directly to the existing collection Update vector schema
    • Re-embed all data in the background using UpdateVectors Update vectors
    • Verify search quality, then delete old vector field
  • If the cluster is v1.17 or earlier OR the collection doesn't have named vectors:

  • Create a new collection with the new model's dimensions and distance metric

  • Re-embed all data into the new collection in the background

  • Point your application at a collection alias instead of a direct collection name

  • Atomically swap the alias to the new collection Switch collection

  • Verify search quality, then delete the old collection

Careful, the alias swap only redirects queries. Payloads must be re-uploaded separately.

Need Both Models Live (Side-by-Side)

Use when: A/B testing models, multi-modal (dense + sparse), or evaluating a new model before committing.

  • If the cluster is v1.18 or later:

  • If the cluster is v1.17 or earlier: You cannot add a named vector to an existing collection. Create a new collection with both vector fields defined upfront:

    • Create new collection with old and new named vectors both defined Collection with multiple vectors
    • Migrate data from old collection, preserving existing vectors in the old named field
    • Backfill new model embeddings incrementally using UpdateVectors Update vectors
    • Compare quality by querying with using: "old_model" vs using: "new_model"
    • Swap alias to new collection once satisfied

Co-locating large multi-vectors (especially ColBERT) with dense vectors degrades ALL queries, even those only using dense. At millions of points, users report 13s latency dropping to 2s after removing ColBERT. Put large vectors on disk during side-by-side migration.

If you anticipate future model migrations, define both vector fields upfront at collection creation.

Dense to Hybrid Search Migration

Use when: adding sparse/BM25 vectors to an existing dense-only collection. Most common migration pattern.

You cannot add sparse vectors to an existing dense-only collection. Must recreate:

  • Create new collection with both dense and sparse vector configs defined
  • Re-embed all data with both dense and sparse models
  • Migrate payloads, swap alias

Sparse vectors at chunk level have different TF-IDF characteristics than document level. Test retrieval quality after migration, especially for non-English text without stop-word removal.

Re-embedding Is Too Slow

Use when: dataset is large and re-embedding is the bottleneck.

  • Use update_mode: insert (v1.17+) for safe idempotent migration Update mode
  • Scroll the old collection with with_vectors=False, re-embed in batches, upsert into new collection
  • Upload in parallel batches (64-256 points per request, 2-4 parallel streams) Bulk upload
  • Disable HNSW during bulk load (set indexing_threshold_kb very high, restore after)
  • For Qdrant Cloud inference, switching models is a config change, not a pipeline change Inference docs

For 400GB+ datasets, expect days. For small datasets (<25MB), re-indexing from source is faster than using the migration tool.

What NOT to Do

  • Assume you can add named vectors to an existing collection on v1.17 or earlier servers; check your server version first
  • Delete the old collection before verifying the new one
  • Forget to update the query embedding model in your application code
  • Skip payload migration when using alias swap (aliases redirect queries, they do not copy data)
  • Keep ColBERT vectors co-located with dense vectors during a long migration (I/O cost degrades all queries)
  • Migrate to hybrid search without testing BM25 quality at chunk level

GitHub 저장소

qdrant/skills
경로: skills/qdrant-model-migration
0
agent-skillsai-agentsclaude-codecodexcursorembeddings

연관 스킬

evaluating-llms-harness

테스팅

이 Claude Skill은 MMLU, GSM8K를 포함한 60개 이상의 표준화된 학술 과제에서 LLM 성능을 벤치마크하기 위해 lm-evaluation-harness를 실행합니다. 개발자들이 모델 품질을 비교하고, 학습 진행 상황을 추적하거나 학술 결과를 보고할 수 있도록 설계되었습니다. 이 도구는 HuggingFace와 vLLM 모델을 포함한 다양한 백엔드를 지원합니다.

스킬 보기

cloudflare-cron-triggers

테스팅

이 스킬은 cron 표현식을 사용하여 Worker를 스케줄링하기 위한 Cloudflare Cron Triggers 구현에 관한 포괄적인 지식을 제공합니다. 주기적 작업, 유지보수 작업, 자동화된 워크플로우 설정 방법을 다루며, 잘못된 cron 표현식이나 시간대 문제 같은 일반적인 이슈들을 해결하는 방법을 포함합니다. 개발자들은 이를 통해 스케줄된 핸들러 구성, cron 트리거 테스트, Workflows 및 Green Compute와의 연동 작업을 수행할 수 있습니다.

스킬 보기

webapp-testing

테스팅

이 Claude Skill은 Python 스크립트를 통해 로컬 웹 애플리케이션을 테스트하기 위한 Playwright 기반 툴킷을 제공합니다. 프론트엔드 검증, UI 디버깅, 스크린샷 캡처, 로그 확인 기능을 지원하며 서버 라이프사이클을 관리합니다. 브라우저 자동화 작업에 사용하되 컨텍스트 오염을 방지하기 위해 소스 코드를 읽지 않고 스크립트를 직접 실행하세요.

스킬 보기

finishing-a-development-branch

테스팅

이 스킬은 테스트 통과를 확인한 후 체계적인 통합 옵션을 제시하여 개발자가 완성된 작업을 마무리하도록 돕습니다. 구현이 완료된 후 머지, PR 생성, 브랜치 정리와 같은 워크플로우를 안내합니다. 코드가 준비되고 테스트가 완료되었을 때 개발 프로세스를 체계적으로 마무리하기 위해 사용하세요.

스킬 보기