Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-3149

Local index got corrupted if intermediate compaction happen during the split.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.8.0
    • 4.8.0
    • None
    • None

    Description

      The scenario is quite simple:
      If we trigger split after index creation when we have a lot of HFiles not yet compacted, the compaction may happen for part of those files and the scan type will be COMPACT_RETAIN_DELETES, but not COMPACT_DROP_DELETES as we expect in preCompactScannerOpen. In this case the regular scanner will be used during compaction and we get incorrectly data in the local index. Discussed it with enis offline and it seems that the check for COMPACT_DROP_DELETES is not necessary and can/should be deleted.

      Attachments

        1. PHOENIX-3149.patch
          1 kB
          Sergey Soldatov

        Activity

          People

            sergey.soldatov Sergey Soldatov
            sergey.soldatov Sergey Soldatov
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: