Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22716

Add metrics watermarkAlignedChannelNum

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Runtime / Metrics
    • Labels:
      None

      Description

      WatermarkStrategy#withIdleness will introduce IDLE state;
      When the downstream Watermark is aligned, the subtask Watermark will be ignored.
      When the status of the subtask changes from IDLE to ACTIVE, the watermark of the subtask is not immediately considered when the downstream Watermark is aligned, until its Watermark is greater than the lastOutputWatermark of the Operator.
      For details, please refer to class StatusWatermarkValve.
      If the downstream is a window operator and delay is not allowed, the data may be drop.
      We should add some metrics to identify the current Watermark alignment, considering the data of multiple channels.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tartarus tartarus
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: