Skip to content
@dataphos

dataphos

An enterprise-class, real time data platform enabling transactional, operational and analytic business applications.
README.md

Welcome to Dataphos!

License

Dataphos is a collection of microservices and supporting libraries designed to solve the common issues arising in the current world of Data Engineering. Read more about Dataphos on our website.

If you're looking to quickly get started with using Dataphos, take a look at the dataphos-core repository.

Dataphos Components

  • Persistor retrieves messages from a topic and stores them in a data lake, with the option to resubmit them when needed.
  • Schema Registry is a cloud-based schema management and message validation system.

License

Dataphos is a product of Syntio Ltd. licensed under the Apache License, Version 2.0

Popular repositories Loading

  1. lib-streamproc lib-streamproc Public

    A Go library that exposes executors, interfaces, data structures, and utility functions which combined a universal stream processor, invariant to any specific messaging system.

    Go 2

  2. schema-registry schema-registry Public

    Schema Registry is a product used for schema management and message validation.

    Go 1 1

  3. lib-retry lib-retry Public

    lib-retry is a lightweight Go library that contains helpful functions which enable retrying any operation, using various backoff strategies.

    Go

  4. lib-httputil lib-httputil Public

    lib-httputil is a small Go library which contains utility functions to standardize and ease usage of basic http functions from the standard library.

    Go

  5. lib-shutdown lib-shutdown Public

    A lightweight Go library which offers utility functions that deal with graceful termination on selected OS signals.

    Go

  6. lib-batchproc lib-batchproc Public

    lib-batchproc is a small Go library which contains utility functions which ease processing of indexable (array-like) collections.

    Go

Repositories

Showing 10 of 13 repositories
  • dataphos-core Public

    The starting point for deploying and using Dataphos components. It contains Pulumi deployment scripts and Helm charts that enable you to quickly launch Dataphos components in your cloud environment with minimal configuration.

    dataphos/dataphos-core’s past year of commit activity
    Python 0 Apache-2.0 0 0 0 Updated Nov 7, 2024
  • dataphos-helm Public

    Helm charts for Dataphos platform components.

    dataphos/dataphos-helm’s past year of commit activity
    JavaScript 0 Apache-2.0 1 1 1 Updated Nov 7, 2024
  • lib-brokers Public

    lib-brokers is a Go library which contains the interfaces used to interact with messaging systems without relying on a specific technology or client library. This library attempts to solve the issue of properly abstracting away the interaction between applications and messaging systems.

    dataphos/lib-brokers’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Oct 22, 2024
  • .github Public

    Community health files for Dataphos

    dataphos/.github’s past year of commit activity
    0 Apache-2.0 0 0 0 Updated Oct 11, 2024
  • dataphos-docs Public

    Official documentation for the Dataphos platform components.

    dataphos/dataphos-docs’s past year of commit activity
    Shell 0 Apache-2.0 0 0 0 Updated Oct 11, 2024
  • schema-registry Public

    Schema Registry is a product used for schema management and message validation.

    dataphos/schema-registry’s past year of commit activity
    Go 1 Apache-2.0 1 0 1 Updated Oct 11, 2024
  • persistor Public

    Persistor is a product used for permanent data storage. It provides support for multiple cloud platforms, more specifically the Google Cloud Platform and Microsoft Azure, as well as for various broker types (GCP PubSub, Azure Service Bus and Kafka) and different kinds of storage services (Google Cloud Storage and Azure Blob Storage).

    dataphos/persistor’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Oct 11, 2024
  • lib-streamproc Public

    A Go library that exposes executors, interfaces, data structures, and utility functions which combined a universal stream processor, invariant to any specific messaging system.

    dataphos/lib-streamproc’s past year of commit activity
    Go 2 Apache-2.0 0 0 0 Updated Oct 11, 2024
  • lib-logger Public

    Common Logging Library

    dataphos/lib-logger’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Oct 11, 2024
  • lib-batchproc Public

    lib-batchproc is a small Go library which contains utility functions which ease processing of indexable (array-like) collections.

    dataphos/lib-batchproc’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Oct 11, 2024
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…