WORKSHOP
From API to Dashboard: Building a Real-Time Data Pipeline with Open-Source Tools
In this practical workshop, participants will follow step by step how a real-time data pipeline is built end-to-end using open-source tools, all running locally with Docker. Using live flight data as a concrete example, the session will cover data ingestion from an API, event streaming with Apache Kafka, storage in PostgreSQL, transformation with dbt, orchestration with Apache Airflow, and visualization in Apache Superset.
Designed for developers, DevOps engineers, data practitioners, and technical professionals interested in modern data architectures, the workshop will offer an applied view of how these components work together in practice. Beyond the technical flow itself, the session will also create space for questions, discussion, and real-world implementation challenges, helping participants better understand both the architecture and the trade-offs behind building production-style data pipelines.