[HBASE-11368] Multi-column family BulkLoad fails if compactions go on too long

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: stack
• Created: 17/Jun/14 03:52
• Updated: 14/Sep/16 19:06
• Resolved: 14/Sep/16 19:04

Description

Compactions take a read lock. If a multi-column family region, before bulk loading, we want to take a write lock on the region. If the compaction takes too long, the bulk load fails.

Various recipes include:
+ Making smaller regions (lame)
+ Victor Xu suggests major compacting just before bulk loading over in HBASE-10882 as a work around.

Does the compaction need a read lock for that long? Does the bulk load need a full write lock when multiple column families? Can we fail more gracefully at least?

Note: Fixed in subtask HBASE-14575

Issue Links

• is related to: HBASE-13530 Add param for bulkload wait duration in HRegion.

Sub-Tasks

• Relax region read lock for compactions: Resolved