[METRON-1624] Set Profiler and Enrichment batch parameters in Ambari

• Type: Improvement
• Status: Done
• Priority: Major
• Resolution: Done
• Fix Version/s: 0.6.0
• Assignee: Nick Allen
• Reporter: Nick Allen
• Created: 19/Jun/18 19:44
• Updated: 05/Sep/18 15:32
• Resolved: 05/Sep/18 15:32

Description

METRON-1594 introduced a mechanism to control the batch size and timeout when writing records to Kafka by updating the global properties.

Both Enrichment and the Profiler write records back into Kafka. The user can independently set the batch size and timeout for each of those.

Currently, the user must set the following global properties using the CLI.

"profiler.writer.batchSize" : 15,
"profiler.writer.batchTimeout" : 0,
"enrichment.writer.batchSize" : 15,
"enrichment.writer.batchTimeout" : 0

The user should be able to adjust these values in Ambari.

Issue Links

• links to: GitHub Pull Request #1069