Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-3065

by default disable inverted index for all the dimension column

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.1
    • None
    • None

    Description

      Bottleneck with invertedIndex:

      1. As for each page first we will sort the data and generate inverted index, data loading performance will get impacted.because of this
      2. Store size is more because of stroing inverted index for each dimension column which results in more IO and it impacts query performance
      3. One extra lookup happenes during query due to presence of inverted index which is causing many cachline miss and it impacts the query performance

      Attachments

        Activity

          People

            akashrn5 Akash R Nilugal
            akashrn5 Akash R Nilugal
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 9h 40m
                9h 40m