[CARBONDATA-2685] make datamap rebuild for all segments in parallel

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0, 1.4.1
• Assignee: Chuanyin Xu
• Reporter: Chuanyin Xu
• Created: 04/Jul/18 02:53
• Updated: 10/Jul/18 11:26
• Resolved: 10/Jul/18 11:26

Description

Currently in carbondata, while rebuilding datamap, one spark job will be
started for each segment and all the jobs are executed serially. If we
have many historical segments, the rebuild will take a lot of time.

Issue Links

• links to: GitHub Pull Request #2443