Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-951

Improve event loop timing metrics

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.10.1
    • Fix Version/s: 0.10.1
    • Component/s: metrics
    • Labels:
      None

      Description

      SAMZA-401 added the event-loop-utilization metric to measure the % active time in the event loop. However, the value for the event-loop-utilization (at least since samza 10) is almost always ~= 1.0, even for over-provisioned jobs, which is not very useful.

      The way it is currently measured, the active time includes choose-ns which includes time spent in poll() waiting for new messages. This waiting should be considered idle time.

      The goals of this ticket are to:
      1. Exclude the choose time from the active time to fix the event-loop-utilization metric.
      2. Add deserialization-ns and poll-ns metrics to help users understand where the time is being spent in the chooser.

        Attachments

        1. SAMZA-951_3.patch
          11 kB
          Jake Maes
        2. SAMZA-951_2.patch
          12 kB
          Jake Maes
        3. SAMZA-951_1.patch
          10 kB
          Jake Maes

          Activity

            People

            • Assignee:
              jmakes Jake Maes
              Reporter:
              jmakes Jake Maes
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: