Run Scala Kinesis Enrich - ClaraVista-IT/snowplow GitHub Wiki
HOME > SNOWPLOW SETUP GUIDE > Step 3: Setting up Enrich > Step 3.2: setting up Scala Kinesis Enrich > 3: Running
This documentation is for version 0.5.0 of Scala Kinesis Enrich. Documentation for other versions is available:
Scala Kinesis Enrich is an executable jarfile which should be runnable from any Unix-like shell environment. Simply provide the configuration file as a parameter:
$ ./scala-kinesis-enrich-0.3.0 --config my.conf --resolver file:resolver.json
This will start the Scala Kinesis Enrich app to read raw events from Kinesis and write enriched events back to Kinesis.
If you are using configurable enrichments, provide the path to your enrichments directory as a parameter:
$ ./scala-kinesis-enrich-0.3.0 --config my.conf --resolver file:resolver.js --enrichments file:path/to/enrichments
If you are storing the resolver and/or enrichments in DynamoDB, use the "dynamodb:" prefix in place of the "file:" prefix:
$ ./scala-kinesis-enrich-0.3.0 --config my.conf --resolver dynamodb:eu-west-1/ConfigurationTable/resolver --enrichments dynamodb:eu-west-1/ConfigurationTable/enrichment_
The above command that the enrichments and resolver are stored in a table named ConfigurationTable in eu-west-1, that the hash key for that table is "id", that the resolver JSON is stored in an item whose hash key has value "resolver", and the enrichments are stored in items whose hash keys have values beginning with "enrichment_".
Scala Kinesis Enrich uses slf4j logging. If you run the executable jarfile using the java -jar command, you can set the log level as a system property:
$ java -jar -Dorg.slf4j.simpleLogger.defaultLogLevel=debug \
scala-kinesis-enrich-0.3.0 --config my.conf --resolver file:resolver.json
This will also affect messages logged by the Kinesis Client Library (which Scala Kinesis Enrich uses to read from Kinesis.)
You have setup Scala Kinesis Enrich! You are now ready to setup alternative data stores.
Return to the setup guide.