Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2204

Add caching to HBaseLookupBolt

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.0, 2.0.0
    • Fix Version/s: 2.0.0, 1.1.0
    • Component/s: storm-hbase
    • Labels:

      Description

      Add capability to cache Results from HBase lookup in HBaseLookupBolt.

      • Caching is disabled by default.
      • Enabled by configuration
        hbase.cache.enable = true
        hbase.cache.ttl.seconds = 300
        hbase.cache.size = 1000

      Using Guava LoadingCache implementation to create an LRU cache.

      Also marking OutputCollector as transient in AbstractHbaseBolt (it should be marked as transient)

      https://github.com/apache/storm/blob/cd5c9e8f904205a6ca6eee9222ca954ca8b37ec3/external/storm-hbase/src/main/java/org/apache/storm/hbase/bolt/HBaseLookupBolt.java

      https://github.com/apache/storm/pull/1783

        Attachments

        1. storm-hbase-cache.patch
          14 kB
          Ambud Sharma

          Activity

            People

            • Assignee:
              ashar103 Ambud Sharma
              Reporter:
              ashar103 Ambud Sharma
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - 2h Original Estimate - 2h
                2h
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10h 20m
                10h 20m