Skip to content

API providing direct access and ETL / ELT data migration capabilities on various databases from MongoDB, Redis, SQL, AWS RDS, Firebase Firestore etc. Developed with Go and external databases.

Notifications You must be signed in to change notification settings

tahmid-saj/data-ingestion-api

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data-ingestion-api

API providing direct access and ETL / ELT data migration capabilities on various databases from MongoDB, Redis, SQL, AWS RDS, Firebase Firestore etc. Developed with Go and external databases.



Directory structure

The directory structure is as follows:

etl-elt-api/ ├── db/
│ - Contains database connection files and schemas. ├── models/
│ - Defines data models used for the API. ├── routes/
│ - Contains the API route definitions for handling requests. ├── utils/
│ - Utility functions and helpers for the application. ├── .gitignore
│ - Specifies files and directories to be ignored by Git. ├── README.md
│ - Documentation file providing an overview of the project. ├── go.mod
│ - Defines the module’s dependencies. ├── go.sum
│ - Contains checksums for module dependencies. └── main.go
- The main entry point of the application, launching the API.



Overview

Design

image Figure 1: High level view of the API and usage in other applications

Similar services can be found here and below:

Similar services

image

The ETL ELT API provides manual data migration for the following applications:

  1. financeplanner.io
  2. nutritiontracker.io
  3. financeprediction.io

The following databases are supported:

  1. MongoDB
  2. Redis
  3. AWS RDS
  4. SQL

About

API providing direct access and ETL / ELT data migration capabilities on various databases from MongoDB, Redis, SQL, AWS RDS, Firebase Firestore etc. Developed with Go and external databases.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages