• | • | • |
May 9, 2023 |
Modern Data Streaming Pipelines |
We are happy to announce that Tim Spann will be our special guest for this month's meeting. |
In this session, I will show you some best practices I have discovered over the last seven years in building data streaming applications including IoT, CDC, Logs, and more. |
In my modern approach, we utilize several Apache frameworks to maximize the best features of all. We often start with Apache NiFi as the orchestrator of streams flowing into Apache Kafka. From there we build streaming ETL with Apache Flink, enhance events with NiFi enrichment. We build continuous queries against our topics with Flink SQL. |
We will show where Java fits in as sources, enrichments, NiFi processors and sinks. |