Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-22314

AggRecordsCombiner should combine buffered records first instead of accumulate on state directly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Invalid
    • None
    • None
    • Table SQL / Runtime
    • None

    Description

      In Window TVF Aggregation, currently, the AggRecordsCombiner accumulates buffered records on state directly. This is not good for performance. We can accumulate records in memory first, and then merge the accumulator into state, if the aggs support merge() method. This can reduce lots of state accessing when having COUNT DISTINCT.

      Attachments

        Activity

          People

            jark Jark Wu
            jark Jark Wu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: