Skip to content

datagram-db/datagram-ETL

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

DATAGRAM ETL

This project implements the ETL for loading the graph operand to traverse using the approximate graph matching. For this reason, there are some third party dependencies in the third_party folder. Some require additional setup, that is explained in the following subsection

Dependencies

RocksDB

Within GNU/Linux, use the following command for installing the dependencies for RocksDB

sudo apt-get install -y libsnappy-dev libgflags-dev zlib1g-dev libbz2-dev liblz4-dev libzstd-dev zlib1g-dev

Running the ETL

In order to run the ETL, make sure that the default TMPFILE in your file system has enough memory for loading the temporary data, sorting it and then preparing the loading of the final data representation. Therefore, In your disk you will need (in the worst case scenario) 3 times the space required to store the original data. Therefore, choose your default TMPDIR wisely and, eventually, set the following environment variable:

export TMPDIR=/path/to/your/custom/tmpdir

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published