[CARBONDATA-1797] Segment_Index compaction should take compaction lock to support concurrent scenarios better

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: dhatchayani
• Reporter: dhatchayani
• Created: 22/Nov/17 11:39
• Updated: 23/Nov/17 10:41
• Resolved: 23/Nov/17 10:41

Description

SEGMENT_INDEX compaction is not taking compaction lock. While concurrent operation, this may be successful but the output may not be as expected.

Scenario:
Execute MINOR compaction and SEGMENT_INDEX compaction concurrently.
As SEGMENT_INDEX compaction is not taking any lock it will do tasks in between, finally some segments index files will be merged, probably the newly created segments may be left out.

Solution:
To take compaction lock

Issue Links

• links to: GitHub Pull Request #1553