Building a Full Ingestion Pipeline Using Apache NiFi

An introductory hands-on class to learn basic concepts of data flow, which will allow you to collect and transport data from numerous sources including real-time events, data from external sources, structured and unstructured data.

1. Introduction
– Data flow & Data pipeline
– ETL vs. ELT
– Data at rest & Data in motion
– Data ingest patterns

2. Basic Concepts
– User Interface
– FlowFile
– Processor
– Connector

3. In-depth
– Expression Language
– Templates
– Data Provenance
– Version Control
– Custom Processor

Audience:
– Developers
– Data engineers