An easy-to-use tool to transfer data between redis servers or clusters.
pip install redis-data-transfer
The command line structure is quite simple:
redis-data-transfer [options] your.source.server your.destination.server
For details about the options available:
redis-data-transfer --help
The implementation is made around a pipeline system with queues and subprocesses. The user can control the number of parallel subprocesses for each step of the pipeline:
- A single scanner reads all keys from the source.
- Checkers look in the destination and filter out any key that already exists. They can be disabled if desired.
- Readers fetch the content of each key from the source.
- Writers store the content for each key in the destination.
The code is hosted on github. The repository uses poetry for packaging. The project uses tox for testing.