Library that allows you to ingest data from mongo database into an s3 bucket.
You want to send all the collections from mongo database into S3 without touching your own implementation. As part of this goal, MongoIngestorS3 allows you to ingest data from mongo to s3 by specifying the format of file.
MongoIngestorS3 is a very lightweight solution allowing you to send data to s3 from mongo, and stored in either csv or json files.
Start by building a development environment
- Install the dependencies of project
$ pip install -r requirements.txt
- An example of the credentials is provided, run the credentials
$ source credentials.sh
A short sample how to use the library
from src.ingestor import Ingestor
data_ingesting = Ingestor()
data_ingesting.start_ingesting('csv')