A Scala API for Apache Beam and Google Cloud Dataflow.

A Scala feature transformation library for data science and machine learning

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

A Giter8 template for scio

A collection of Scio exercises inspired by Ruby Koans and many others.

Community-supported add-ons for Scio

Collection of additional string interpolators to use in your scio pipeline

Playground for Apache Beam and Scio experiments, driven by real-world use cases.

leverage cats type classes and data types in scio pipelines

WIP: Moving data from GCS to BigQuery.

Example of how to run Scio job with Dataflow Flex Template

Comparing Bigdata IOs

Learn how to develop and test stateful streaming and batch data pipelines

This repository contains a sample pipeline for starting with Scio, the Scala framework to develop Apache Beam pipelines. Fork this repository so you can commit your changes in your own repository.

A Scio extension that allows SPARQL to query a collection of triples

Dataflow job to dump the content coming from a PubSub subscription into Cloud storage

Playing w/ Scio

Main repository of IndexGADM

Functional Big Data Processing API