Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10500

Some tools OOM when BucketCache is enabled

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.98.0, 0.96.0, 0.99.0
    • Fix Version/s: 0.96.2, 0.98.1, 0.99.0
    • Component/s: HFile
    • Labels:
      None

      Description

      Running hbck --repair or LoadIncrementalHFiles when BucketCache is enabled in offheap mode can cause OOM. This is apparently because bin/hbase does not include $HBASE_REGIONSERVER_OPTS for these tools. This results in HRegion or HFileReaders initialized with a CacheConfig that doesn't have the necessary Direct Memory.

      Possible solutions include:

      • disable blockcache in the config used by hbck when running its repairs
      • include HBASE_REGIONSERVER_OPTS in the HBaseFSCK startup arguments

      I'm leaning toward the former because it's possible that hbck is run on a host with different hardware profile as the RS.

        Attachments

        1. HBASE-10500.00.patch
          2 kB
          Nick Dimiduk
        2. HBASE-10500.01.patch
          6 kB
          Nick Dimiduk

          Activity

            People

            • Assignee:
              ndimiduk Nick Dimiduk
              Reporter:
              ndimiduk Nick Dimiduk
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: