XMLWordPrintableJSON

Details

    • The default granularity for latency metrics was modified. To restore the previous behavior users have to explicitly set the granularity to SUBTASK.

    Description

      The latency is currently tracked separately from each operator subtask to each source subtask. The total number of latency metrics in the cluster is thus (# of sources) * (# of operators) * parallelismĀ², i.e. quadratic scaling.

      If we'd ignore the source subtask the scaling would be a lot more manageable.

      Attachments

        Issue Links

          Activity

            People

              chesnay Chesnay Schepler
              chesnay Chesnay Schepler
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: