[HBASE-6459] improve speed of table creation

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.94.0
• Fix Version/s: 0.95.0
• Hadoop Flags: Reviewed
• Assignee: Zhou wenjian
• Reporter: zhou wenjian
• Created: 26/Jul/12 08:57
• Updated: 23/Sep/13 18:30
• Resolved: 19/Oct/12 20:47

Description

in CreateTableHandler
for (int regionIdx = 0; regionIdx < this.newRegions.length; regionIdx++) {
HRegionInfo newRegion = this.newRegions[regionIdx];
// 1. Create HRegion
HRegion region = HRegion.createHRegion(newRegion,
this.fileSystemManager.getRootDir(), this.conf,
this.hTableDescriptor, null, false, true);

regionInfos.add(region.getRegionInfo());
if (regionIdx % batchSize == 0)

{ // 2. Insert into META MetaEditor.addRegionsToMeta(this.catalogTracker, regionInfos); regionInfos.clear(); }

// 3. Close the new region to flush to disk. Close log file too.
region.close();
}
All the region will be create serially.
If we have thousands of regions, that will be a huge cost.
We can improve it by create the region in parallel