Qdrant Migration Tool
QdrantOfficialPublished by Qdrant
- Skill
- Tool integration
- Cloud and DevOps
- Apache-2.0
- No issues found
AutoGineer summary
Written by AutoGineer from the skill’s own files, not by the author
The Qdrant Migration Tool is a Docker-based utility designed to streamline the transfer of vectors, metadata, and sparse embeddings from external databases into Qdrant. It operates by streaming data in batches through the host machine, supporting automatic resumption of interrupted tasks. The tool requires specific subcommands for different source databases and provides configuration options for batch sizes and network connectivity to optimize performance.
What it does
- Provides guidance on using the Qdrant Migration Tool CLI for database migrations.
- Explains how to select and configure source-specific subcommands for various vector databases.
- Offers instructions for resuming interrupted migration processes.
- Details performance tuning parameters like batch size and worker counts.
- Outlines requirements for manual collection creation for specific source databases.
- Provides advice on verifying data integrity and search quality after migration.
When to use it
- When migrating vector data from sources like Pinecone, Weaviate, Milvus, or others to Qdrant.
- When troubleshooting slow migration speeds or interrupted data transfers.
- When configuring migration settings for local database instances.
- When preparing to verify data consistency after a migration is complete.
Advantages
- Supports automatic resumption of migrations without restarting from scratch.
- Provides a standardized approach for migrating from a wide range of vector database sources.
- Allows for performance optimization through configurable batch sizes.
- Includes guidance on data verification to ensure post-migration accuracy.
Usage examples
- “How do I migrate my data from Pinecone to Qdrant?”
- The agent will guide you to use the pinecone subcommand of the migration tool and explain the necessary credential and mapping steps.
- “My migration from MongoDB was interrupted, how do I resume it?”
- The agent will explain that re-running the same command will automatically resume the process using the _migration_offsets collection.
- “The migration is running too slowly, what can I do?”
- The agent will suggest increasing the --migration.batch-size parameter and ensuring the migration container is running close to the databases.
- “Do I need to create the collection in Qdrant before migrating from Weaviate?”
- The agent will confirm that you must manually create the target collection in Qdrant first, as Weaviate does not expose the necessary dimensions to the tool.
Install
Download the skill as a ZIP:
https://autogineer.com/agent-skills/qdrant/qdrant-migration-tool/downloadUnzip it into the cross-client skills folder of your project:
mkdir -p .agents/skills && unzip qdrant-migration-tool.zip -d .agents/skills
Documentation by Qdrant
Qdrant Migration Tool
The tool is a Docker container (registry.cloud.qdrant.io/library/qdrant-migration), not a library you import. It streams data in batches through the machine it runs on rather than connecting source and target directly, and it resumes by default rather than restarting from scratch. Migrate to Qdrant
Picking the Right Subcommand
Use when: starting a new migration and choosing the source-specific CLI subcommand.
Match the source to its subcommand:
pinecone,weaviate,milvus,elasticsearch,opensearch,pg(pgvector),s3(S3 Vectors),azure(Azure AI Search),chroma,redis,mongodb,faiss,solr, orqdrant. Migrate to QdrantWeaviate, Redis, MongoDB, and Apache Solr do not auto-create the target collection; create it in Qdrant first with matching vector size and distance metric before running the migration. All other sources auto-create it.
Each source has its own credential and mapping guide; read it before running the migration, since concept mapping (namespaces, indexes, metadata fields) is source-specific. Pinecone Weaviate Milvus Elasticsearch OpenSearch Azure AI search pgvector S3 Vectors Chroma Redis MongoDB FAISS Apache Solr Qdrant-to-Qdrant
Source not listed? Point to the GitHub issue tracker rather than improvising a custom pipeline. Open an issue
Running Against Local Instances
Use when: either the source or target database runs on the same machine as the migration container.
Add
--net=hostto thedocker runcommand; without it, the container cannot resolvelocalhoston the host machine. Migrate to QdrantRun the container on a machine with low latency to both databases. Direct source-target connectivity is not required since the tool streams through wherever it runs, but round trips from the migration host to each database still add up.
Migration Was Interrupted
Use when: a migration stopped partway through and needs to continue, or needs to be re-run from zero.
Re-run the exact same command. Progress is tracked in the
_migration_offsetscollection in Qdrant, so it resumes automatically rather than re-copying already-migrated points.Pass
--migration.restartto discard saved progress and start over, e.g. after fixing a bad source-side filter or changing collection schema mid-migration.Custom offsets-collection name only matters if you're running multiple concurrent migrations into the same Qdrant instance; otherwise leave
--migration.offsets-collectionat its default to avoid tracking state you'll forget to look for later.
Migration Is Too Slow
Use when: throughput is too low for the size of the source dataset.
Raise
--migration.batch-sizefrom the default of 50 to 256 or 512 for large migrations; small batches under-use each upsert round trip.--migration.num-workersonly exists for thepgandqdrantsubcommands; other sources have no parallel-worker flag, so throughput there is bounded by batch size and network proximity alone.--migration.batch-delaydefaults to 0; only raise it deliberately to throttle load on a source database that can't absorb full-speed reads, not as a default tuning knob.Run the container close to both databases rather than over a slow network path, since the tool has no way to compensate for source/target latency.
After Migration
Use when: the migration command finished and data needs to be trusted before cutting over traffic.
Run through the verification framework rather than spot-checking a few points: it covers pre-migration baselines, data integrity checks, and search-quality validation, not just point counts. Migration Verification Guide
If Postgres/pgvector stays live alongside Qdrant post-migration, set up an ongoing sync strategy (event-driven, batch, or dual-write) instead of treating the migration as a one-time cutover. Keeping Postgres in Sync
What NOT to Do
Assume Weaviate, Redis, MongoDB, or Solr auto-create the target collection; these sources don't expose vector dimensions or distance metric to the tool, so the collection must be created manually first with settings that exactly match the source. Migrate to Qdrant
Point the
faisssubcommand at a quantized FAISS index; onlyIndexFlatL2,IndexFlatIP,IndexHNSWFlat, andIndexIVFFlatare supported, since quantized indexes don't retain the original vectors. FAISSAssume every Pinecone index can be migrated; only serverless indexes support the list operation the tool needs to enumerate vectors.Pinecone
Run a
qdrant-to-qdrantmigration into an existing target collection without checking its vector size first; source and target dimensions must match exactly, only replication and shard settings are allowed to differ.Connect over TLS to a source or target signed by a private or self-signed CA without mounting it via
SSL_CERT_FILE; the migration fails on certificate verification instead of degrading gracefully, and--skip-tls-verificationshould be a deliberate override, not a default fix.Pass
--migration.restartout of caution on a healthy resume; it discards saved progress and re-streams data that already migrated.Treat a completed migration run as verified without running data integrity and search quality checks.
Files
- ATTRIBUTION.mdAdded by AutoGineer854 B
- LICENSELicence file added by AutoGineer11.1 KiB
- SKILL.md7.5 KiB
Requirements and compatibility
Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta
“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.
Security
No issues found by our static scan· No issues found
A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.
Attribution and licence
- Published by
- Qdrant
- Publisher
- Qdrant (Official)
- Source
- qdrant/skills · skills/qdrant-migration-tool · commit 9f55f6a
- Licence
- Apache License 2.0 (redistribution allowed)
- LICENSE (added by AutoGineer from LICENSE)
- ATTRIBUTION.md (written by AutoGineer)
- Synced
AutoGineer is not affiliated with or endorsed by Qdrant or Qdrant.
Download ZIP
The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download qdrant-migration-tool.zip