Architecture Overview

This page provides an overview of the current architecture for the GlassFlow ClickHouse ETL. The system is designed to orchestrate data pipelines that ingest, deduplicate, join, and sink data from Kafka into ClickHouse, leveraging a modular and scalable event-driven approach.

Architecture Components

For a detailed description of each component, see the System Components page.

Data Flow Summary

Learn how data flows through GlassFlow pipelines and how acknowledgment ensures reliable processing in the Data Flow page.