[TEPHRA-299] Executing a large batch delete is very slow

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.0-incubating
• Fix Version/s: 0.16.0
• Assignee: Lars Hofhansl
• Reporter: Lars Hofhansl
• Created: 13/Apr/19 19:13
• Updated: 04/Dec/20 04:46
• Resolved: 09/Jun/19 23:28

Description

I noticed that batch deletes are quire slow. In the profiler I found that almost all of the time is spent in org.apache.hadoop.hbase.regionserver.wal.FSHLog.blockOnSync().

Looking at TransactionProcessor.preDelete it is obvious why:

The batch delete is translated into single puts that are added to the region one by one, so each time the WAL is flushed.

 

Issue Links

• relates to: HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors