Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-28976

Changelog 1st materialization delayed unneccesarily

    XMLWordPrintableJSON

Details

    Description

      In PeriodicMaterializationManager.start(), the 1st materialization is scheduled with a delay: materialization_interval + random_offset

      Here, random_offset is added to avoid thundering herd problem.
      The next materialization will be scheduled with a delay of only materialization_interval.

      That means that the 1st materialization will have to compact up to 2 times more state changes than the subsequent ones.

      Which in turn can cause FLINK--26590 or other problems.

      Attachments

        Issue Links

          Activity

            People

              roman Roman Khachatryan
              roman Roman Khachatryan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: