Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3986

multiple issues during compaction and concurrent scenarios

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.0
    • Component/s: None
    • Labels:
      None

      Description

      multiple issues during compaction and concurrent scenarios
      a) Auto compaction/multiple times minor compaction is called, it was considering compacted segments and coming compaction again ad overwriting the files and segments
      b) Minor/ auto compaction should skip >=2 level segments, now only skipping =2 level segments
      c) when compaction failed, no need to call merge index
      d) At executor, When segment file or table status file failed to write during merge index event, need to remove the stale files.
      e) during partial load cleanup segment folders are removed but segment metadata files were not removed
      f) Some table status retry issues

        Attachments

          Activity

            People

            • Assignee:
              Ajantha_Bhat Ajantha Bhat
              Reporter:
              Ajantha_Bhat Ajantha Bhat
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 10m
                3h 10m