Data Sink

What is a Data Sink?

A Data Sink is a destination where processed data is sent after passing through the transformation function in your GlassFlow pipeline. This can be a dashboard application displaying real-time analytics, a machine learning platform consuming enriched data for predictions, a reporting tool generating periodic reports based on processed data, or storage where you want to store, analyze, or visualize the processed data.

Ways to Connect to Data Sinks

Built-in Integrations

Integrations are fully managed services and provide seamless, out-of-the-box connectivity to common data sinks. These integrations are fully supported and maintained by the GlassFlow team. These integrations make it easier to connect to destinations without infrastructure setup.

• Example Use Case: Exporting data to Amazon S3, Google BigQuery, or SQL Database.

Using Python SDK

Python SDK lets you send data to any data destination from the GlassFlow pipelines. Create custom data sinks to specify exactly how and where the data should be sent after processing.

• Example Use Case: You need to send processed data to a data sink that does not have a GlassFlow built-in integration.