Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-1892

Support volatile range for segments auto merge

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: v1.5.2
    • Fix Version/s: v2.3.0
    • Component/s: Job Engine
    • Labels:
      None

      Description

      We always has some data need to be amended some days later

      in current kylin, once I set Auto Merge Thresholds, the segment newly build will merge if reach Thresholds, the next day refresh will refresh merged segemnt, which is unnecessary.

      So I want to add a interval configuration means auto merge will merge segments outside of the interval.

      for example, if interval = 2, Auto Merge Thresholds=7, if 07-01 to 07-07 is built, auto merge will not trigger, when 07-09 built success, auto merge will trigger and merge segments from 07-01 to 07-07.

        Attachments

        1. KYLIN-1892.v3.patch
          11 kB
          Yang Hao

          Issue Links

            Activity

              People

              • Assignee:
                yanghaogn Yang Hao
                Reporter:
                feng_xiao_yu fengYu
              • Votes:
                1 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: