Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-876

Clear segment access count ASAP

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • hadoop-integration
    • None
    • Spark 2.1 + CarbonData 1.1.0

    Description

      Currently, we will clear access count for all segments after getSplits finished, this will keep the index in memory more time, but if we don't have enough memory, then will query failed, so clear access count after getSplits for each segment, then we can remove the index tree if we don't have enough memory to load index tree for other segments.

      Attachments

        Activity

          People

            Sephiroth-Lin Weizhong
            Sephiroth-Lin Weizhong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h 50m
                3h 50m