Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-4251

optimize clean index file performance

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.2.0
    • 2.2.0
    • core
    • None

    Description

      When cleanfile cleans up data, it cleans up all the carbonindex and carbonmergeindex that once existed, even though many carbonindex have been all deleted, which have been merged into carbonergeindex. considering that there are tens of thousands of carbonindex that once existed after the completion of the compaction, the clean file command will take serveral hours.
      Here, we just need to clean up the existing files, carbonmergeindex or carbonindex files

      Attachments

        Activity

          People

            Unassigned Unassigned
            shenjiayu Jiayu Shen
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 5h 40m
                5h 40m