[CAMEL-5824] camel-hbase - HBase data access performance improvement

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.10.2
• Fix Version/s: 2.10.3, 2.11.0
• Component/s: camel-hbase
• Labels: performance

Environment

OS:CentOS6.2 64bit
CPU:Core i7 2700
Memory:16GB
HDD:WD20EARX(2TB SATA600)

• Patch Info: Patch Available
• Estimated Complexity: Novice
• Assignee: Willem Jiang
• Reporter: Sotaro Kimura
• Created: 26/Nov/12 22:57
• Updated: 29/Nov/12 11:07
• Resolved: 29/Nov/12 11:07

Description

In testing hbase client using camel-hbase component,
data put performance is low.
( about 20 put operation / second, I use Core i7 2700K machine.)

I confirmed performance bottleneck.
And I find bottleneck below

• Everytime camel-hbase component put data,
  camel-hbase component creates and closes HTableInterface.
• But HTableInterface create cost is high.
  So camel-hbase component performance is low.

Performance problem is fixed by using HTablePool at HBaseProducer,
data put performance is improved 20 operetion/second to 200 operation/second.

Modified source is below( and attach patchfile.txt)

• HBaseProducer.java(orig)
  ----------------------------
  104 table.close();
  ----------------------------
• HBaseProducer.java(improved)
  ----------------------------
  104 tablePool.putTable(table);
  ----------------------------