[STORM-2204] Add caching to HBaseLookupBolt

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.0, 2.0.0
• Fix Version/s: 2.0.0, 1.1.0
• Component/s: storm-hbase
• Labels: patch
• Assignee: Ambud Sharma
• Reporter: Ambud Sharma
• Created: 17/Nov/16 03:17
• Updated: 05/Jan/17 03:27
• Resolved: 05/Jan/17 03:27

Description

Add capability to cache Results from HBase lookup in HBaseLookupBolt.

• Caching is disabled by default.
• Enabled by configuration
  hbase.cache.enable = true
  hbase.cache.ttl.seconds = 300
  hbase.cache.size = 1000

Using Guava LoadingCache implementation to create an LRU cache.

Also marking OutputCollector as transient in AbstractHbaseBolt (it should be marked as transient)

https://github.com/apache/storm/blob/cd5c9e8f904205a6ca6eee9222ca954ca8b37ec3/external/storm-hbase/src/main/java/org/apache/storm/hbase/bolt/HBaseLookupBolt.java

https://github.com/apache/storm/pull/1783

Issue Links

• links to: GitHub Pull Request #1783
• links to: GitHub Pull Request #1810