Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-10660

MR over snapshots can OOM when alternative blockcache is enabled

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.98.0, 0.99.0
    • 0.98.1, 0.99.0
    • mapreduce
    • None
    • Reviewed

    Description

      Running IntegrationTestTableSnapshotInputFormat with the BucketCache enabled results in OOM. The map task is running a sequential scan over the region region it opened, so probably it's not benefiting much from a blockcache. Just disable blockcache entirely for these scans because it's likely the cache config detected is designed for a RS running on a different class of hardware than that running the map task.

      Attachments

        1. HBASE-10660.00.patch
          2 kB
          Nick Dimiduk
        2. HBASE-10660.01.patch
          6 kB
          Nick Dimiduk
        3. HBASE-10660.02.patch
          7 kB
          Nick Dimiduk
        4. HBASE-10660.03.patch
          7 kB
          Nick Dimiduk

        Activity

          People

            ndimiduk Nick Dimiduk
            ndimiduk Nick Dimiduk
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: