Basic Nifi Usage - noharm-ai/nifi-docker GitHub Wiki

This tutorial will cover the main proccess of NoHarm integration ilustrated by this picture:

Department ETL

Controllers

  • DBCPConnectionPool - Oracle
  • DBCPConnectionPool - PostgreSQL
  • AvroReader
  • AvroRecordSetWriter

Pull Oracle Data

Is a QueryDatabaseTable Processor with a DBCPConnectionPool Controller dependency.

Map Schema

Is a ConvertAvroSchema Processor

Try Insert into PostgreSQL

Is a PutDatabaseRecord Processor with a DBCPConnectionPool Controller dependency.

Update PostgreSQL on Conflict

Is another PutDatabaseRecord Processor with a DBCPConnectionPool Controller dependency.