Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-3367

Delta file with full of delete op can not be schedule to compact

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.17.0
    • compaction
    • None

    Description

      If we get a REDO delta with full of delete op, wich means there is no update op in the file. The current compact algorithm will not schedule the file do compact. If such files exist, after accumulating for a period of time, it will greatly affect our scan speed. However, processing such files every time compact reduces  compact's performance.

      Attachments

        1. image-2022-11-14-11-02-33-685.png
          19 kB
          dengke
        2. image-2022-05-09-14-32-51-573.png
          10 kB
          dengke
        3. image-2022-05-09-14-26-45-313.png
          174 kB
          dengke
        4. image-2022-05-09-14-23-43-973.png
          502 kB
          dengke
        5. image-2022-05-09-14-21-47-374.png
          309 kB
          dengke
        6. image-2022-05-09-14-19-56-933.png
          856 kB
          dengke
        7. image-2022-05-09-14-18-05-647.png
          297 kB
          dengke
        8. image-2022-05-09-14-16-31-828.png
          164 kB
          dengke
        9. image-2022-05-09-14-13-16-525.png
          495 kB
          dengke

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. KUDU-3619 The 'supplement to GC algorithm' breaks major delta compaction

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. KUDU-1625 Schedule compaction on rowsets with high percentage of deleted data

          • Major - Major loss of function.
          • Open

          Activity

            People

              Koppa dengke
              Koppa dengke
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: