Apache Spark - A unified analytics engine for large-scale data processing

Apache Flink

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

ClickHouse® is a real-time analytics DBMS

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

The official home of the Presto distributed SQL query engine for big data

Apache Hive

Apache Beam is a unified programming model for Batch and Streaming data processing.

大数据入门指南 ⭐

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

The Data Engineering Cookbook

CMAK is a tool for managing Apache Kafka clusters

Apache Calcite

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

PredictionIO, a machine learning server for developers and ML engineers.

Apache Ignite

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs