Details

    • Release Note:
      The default granularity for latency metrics was modified. To restore the previous behavior users have to explicitly set the granularity to SUBTASK.

      Description

      The latency is currently tracked separately from each operator subtask to each source subtask. The total number of latency metrics in the cluster is thus (# of sources) * (# of operators) * parallelism², i.e. quadratic scaling.

      If we'd ignore the source subtask the scaling would be a lot more manageable.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Zentol Chesnay Schepler
                Reporter:
                Zentol Chesnay Schepler
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: