This is a repo with links to everything you'd ever want to learn about data engineering
-
Updated
Dec 23, 2024 - Jupyter Notebook
#
bigdata
Here are 2,174 public repositories matching this topic...
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
iot sql database monitoring time-series metrics cluster bigdata scalability distributed cloud-native financial-analysis tsdb time-series-database connected-vehicles industrial-iot tdengine
-
Updated
Dec 24, 2024 - C
Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.
mysql sql database bigdata postgresql shard distributed-database encrypt data-pipeline data-encryption database-cluster distributed-transaction read-write-splitting database-middleware distributed-sql-database database-gateway
-
Updated
Dec 24, 2024 - Java
A curated list of awesome big data frameworks, ressources and other awesomeness.
data-science data awesome database data-stream bigdata series-database data-visualization data-warehouse stream-processing data-analytics awesome-list distributed-database visualize-data streaming-data
-
Updated
May 7, 2024
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
go redis golang distributed-systems storage filesystem bigdata s3 posix hdfs cloud-native object-storage
-
Updated
Dec 24, 2024 - Go
Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
visualization python data-science machine-learning bigdata tabular-data hdf5 machinelearning dataframe memory-mapped-file pyarrow
-
Updated
Oct 8, 2024 - Python
𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
-
Updated
Dec 24, 2024 - Rust
Upserts, Deletes And Incremental Processing on Big Data.
bigdata stream-processing data-integration datalake apachespark hudi apachehudi incremental-processing apacheflink
-
Updated
Dec 24, 2024 - Java
A Cloud Native Batch System (Project under CNCF)
-
Updated
Dec 24, 2024 - Go
A data integration framework
-
Updated
Nov 28, 2024 - Java
🔨 用 JSON 来生成结构化的 SQL 语句，基于 Vue3 + TypeScript + Vite + Ant Design + MonacoEditor 实现，项目简单（重逻辑轻页面）、适合练手~
-
Updated
Jan 17, 2024 - Vue
100+套大数据可视化炫酷大屏Html5模板；包含行业：社区、物业、政务、交通、金融银行等，全网最新、最多，最全、最酷、最炫大数据可视化模板。陆续更新中
-
Updated
Jul 24, 2024 - JavaScript
GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.
-
Updated
Nov 13, 2024 - C++
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
microsoft emr machine-learning streaming spark apache-spark csharp fsharp analytics dotnet azure bigdata spark-streaming dotnet-core dotnet-standard databricks spark-sql tpcds hdinsight tpch
-
Updated
Dec 20, 2024 - C#
Improve this page
Add a description, image, and links to the bigdata topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the bigdata topic, visit your repo's landing page and select "manage topics."