Data Sink

What is a Data Sink?

A Data Sink is a destination where processed data is sent after passing through the transformation function in your GlassFlow pipeline. This can be a dashboard application displaying real-time analytics, a machine learning platform consuming enriched data for predictions, a reporting tool generating periodic reports based on processed data, or storage where you want to store, analyze, or visualize the processed data.

Ways to Connect to Data Sinks

Managed Integrations

Integrations are fully managed services and provide seamless, out-of-the-box connectivity to common data sinks. These integrations are fully supported and maintained by the GlassFlow team. These integrations make it easier to connect to destinations without infrastructure setup.

• Example Use Case: Sending transformed data to Amazon S3, Snowflake, or analytical databases like Clickhouse.

Using Python SDK

Python SDK lets you send data to any data destination from the GlassFlow pipelines. Create custom data sinks to specify exactly how and where the data should be sent after processing.

• Example Use Case: You need to send processed data to a data sink that does not have a GlassFlow managed integration.