Concepts

GlassFlow is built around several core concepts that make it easy to design and manage event-driven data pipelines. Understanding these concepts is essential to effectively utilize the platform.

---

Core Concepts

Pipeline

A pipeline is the backbone of GlassFlow, defining the flow of data from sources to transformations and then to destinations (sinks). Learn how to create, configure, and manage pipelines.

Space

A Space represents an isolated environment within GlassFlow, where you can organize and manage pipelines, data sources, and sinks. Understand the benefits of using Spaces for better resource organization.

Data Transformation

Data transformation is the process of modifying, enriching, or cleaning data as it moves through a pipeline. Explore how to write custom transformations in Python.

Data Source

A Data Source is where your data originates, such as an API, database, or file storage. Learn how to configure and connect various sources to your pipelines.

Data Sink

A Data Sink is the destination where processed data is sent, such as another API, storage service, or database. Explore how to define and configure sinks for your pipelines.