Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3149

Local index got corrupted if intermediate compaction happen during the split.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.8.0
    • Fix Version/s: 4.8.0
    • Labels:
      None

      Description

      The scenario is quite simple:
      If we trigger split after index creation when we have a lot of HFiles not yet compacted, the compaction may happen for part of those files and the scan type will be COMPACT_RETAIN_DELETES, but not COMPACT_DROP_DELETES as we expect in preCompactScannerOpen. In this case the regular scanner will be used during compaction and we get incorrectly data in the local index. Discussed it with Enis Soztutar offline and it seems that the check for COMPACT_DROP_DELETES is not necessary and can/should be deleted.

        Attachments

          Activity

            People

            • Assignee:
              sergey.soldatov Sergey Soldatov
              Reporter:
              sergey.soldatov Sergey Soldatov
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: