[HBASE-13530] Add param for bulkload wait duration in HRegion.

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 0.98.12
• Fix Version/s: 2.0.0
• Component/s: regionserver
• Assignee: Unassigned
• Reporter: Victor Xu
• Created: 22/Apr/15 12:41
• Updated: 24/Jun/22 18:42
• Resolved: 02/Mar/18 01:32

Description

In our scenario, incremental read/write operations and complete bulkload operations are mixed together. Bulkload needs write lock while read/write and flush/compact need read lock. When a region is compacting, the bulkload could hang at writeLock.tryLock(waitDuration, TimeUnit) method. The original default waitDuration is 60sec (from 'hbase.busy.wait.duration'), and this could block all read/writes operations from acquiring read lock for 1 minute. The chances of this scenario become high when compaction speed limit feature(HBASE-8329) is used.
Maybe we need to decrease the wait duration ONLY for bulkload, and let read/write keep theirs. So I add this param('hbase.bulkload.wait.duration') to tune wait duration for bulkloading. Of course, it is a table level setting, and the default value is from original logic.

Issue Links

• relates to: HBASE-11368 Multi-column family BulkLoad fails if compactions go on too long