Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.10.1
    • Fix Version/s: 0.10.1
    • Component/s: metrics
    • Labels:
      None

      Description

      SAMZA-401 added the event-loop-utilization metric to measure the % active time in the event loop. However, the value for the event-loop-utilization (at least since samza 10) is almost always ~= 1.0, even for over-provisioned jobs, which is not very useful.

      The way it is currently measured, the active time includes choose-ns which includes time spent in poll() waiting for new messages. This waiting should be considered idle time.

      The goals of this ticket are to:
      1. Exclude the choose time from the active time to fix the event-loop-utilization metric.
      2. Add deserialization-ns and poll-ns metrics to help users understand where the time is being spent in the chooser.

      1. SAMZA-951_1.patch
        10 kB
        Jake Maes
      2. SAMZA-951_2.patch
        12 kB
        Jake Maes
      3. SAMZA-951_3.patch
        11 kB
        Jake Maes

        Activity

        Show
        jmakes Jake Maes added a comment - https://reviews.apache.org/r/47620/
        Hide
        nickpan47 Yi Pan (Data Infrastructure) added a comment -

        Merged and submitted. Thanks!

        Show
        nickpan47 Yi Pan (Data Infrastructure) added a comment - Merged and submitted. Thanks!

          People

          • Assignee:
            jmakes Jake Maes
            Reporter:
            jmakes Jake Maes
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development