A repository containing some common purpose scripts that are helpful for data/software engineers.
- Generator based Query Retrieval
- Downloading from SFTP:
- based on last_modified_time (last x days, hours or minutes)
- download all folders to local, and create a tar file for each folder
- Gitlab to Github Migration
- How to use Python Gitlab to automate creation of a branch, pushing the code to that branch and create a merge request.
- A basic PDF Reader
- Vault retrieval and updation
- Verify sftp conenctions with and without proxy
- How to check for checksum between two files to know if there has been a modification.
- Pgp file decryption script