Uploaded image for project: 'Metron'
  1. Metron
  2. METRON-1624

Set Profiler and Enrichment batch parameters in Ambari

    Details

    • Type: Improvement
    • Status: Done
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 0.6.0
    • Labels:
      None

      Description

      METRON-1594 introduced a mechanism to control the batch size and timeout when writing records to Kafka by updating the global properties.

      Both Enrichment and the Profiler write records back into Kafka. The user can independently set the batch size and timeout for each of those.

      Currently, the user must set the following global properties using the CLI.

      "profiler.writer.batchSize" : 15,
      "profiler.writer.batchTimeout" : 0,
      "enrichment.writer.batchSize" : 15,
      "enrichment.writer.batchTimeout" : 0
      

      The user should be able to adjust these values in Ambari.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                nickwallen Nick Allen
                Reporter:
                nickwallen Nick Allen
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: