GlassFlow Examples

This repository is your starting point for exploring examples and use cases for GlassFlow.

Pre-requisite

• Create your free GlassFlow account via the GlassFlow WebApp.
• Get your Personal Access Token to authorize the Python SDK to interact with GlassFlow Cloud.
• Clone this repository to your local machine to access all the examples:

  git clone https://github.com/glassflow/glassflow-examples.git

Explore

Usage

Learn how to use the GlassFlow Python SDK:

• Create Pipeline: How to create a new pipeline.
• Get Pipeline: How to get information about an existing pipeline.
• Manage Pipeline: How to update a pipeline and how to pause it.
• Send and Receive events: How to push and consume events to/from a pipeline.

Basic Examples

These are some basic examples that you can try with GlassFlow. The examples here should be familiar to you as a data engineer and will show you how GlassFlow works and how you can interact with it.

• Email Encryption: Showcases how to hash email addresses (or other PII information) before sending them to your data warehouse.

• Log format conversion: Showcases how to transform Open Telemetry log formats into a structure that can be ingested into ClickHouse.

• Unstructured to Structured Data (coming soon)