[CARBONDATA-2019] Enhancement of merge index compaction feature to support creation of merge index file on old store where index file does not contain the blocklet info

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Manish Gupta
• Reporter: Manish Gupta
• Created: 11/Jan/18 08:31
• Updated: 16/Jan/18 10:37
• Resolved: 16/Jan/18 10:37

Description

Enhancement of merge index compaction feature to support creation of merge index file on old store where index file does not contain the blocklet info.
Old store created with carbondata 1.1 version does not contain the blocklet info in the index file. On that store if merge index file is created then blocklet information will not be present in the merge index file and for first time query again carbondata file footer will be read for blocklet information retrieval.
Benefits:
1. Support merge index file creation on old store
2. Improve first time query performance.

Note: First time query performance will be improved only if merge index file is created before running the first query

Issue Links

• links to: GitHub Pull Request #1782