Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15240

Go Big BucketCache Fixes

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • None
    • None
    • BucketCache
    • None

    Description

      Umbrella issue to which we will attach issues that prevent bucketcache going big; there's a few.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-17204 Make Off heap Bucket Cache default ON

          • Blocker - Blocks development and/or testing work, production could not run
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-16993 BucketCache throw java.io.IOException: Invalid HFile block magic when configuring hbase.bucketcache.bucket.sizes

          • Major - Major loss of function.
          • Resolved
          1.
          		 HFileReaderV2 prefetch overreaches; runs off the end of the data Sub-task Resolved Michael Stack
          2.
          		 Blockcache hits hbase.ui.blockcache.by.file.max limit and is silent that it will load no more blocks Sub-task Resolved Unassigned
          3.
          		 BLOCKSIZE 4k should result in 4096 bytes on disk; i.e. fit inside a BucketCache 'block' of 4k Sub-task Resolved Unassigned
          4.
          		 Allow more than one backing file in bucketcache Sub-task Resolved Chunhui Shen
          5.
          		 Remove unnecessary or Document constraints on BucketCache possible bucket sizes Sub-task Resolved Unassigned
          6.
          		 Add doc, trace-level logging, and test around hfileblock Sub-task Resolved Michael Stack
          7.
          		 PREFETCH_BLOCKS_ON_OPEN in HColumnDescriptor is ignored Sub-task Resolved Michael Stack
          8.
          		 Single Cell Get reads two HFileBlocks Sub-task Resolved Michael Stack
          9.
          		 TestHFileBackedByBucketCache is flakey since it went in Sub-task Resolved Michael Stack
          10.
          		 Convert TestStoreScanner to junit4 from junit3 and clean up close of scanners Sub-task Resolved Michael Stack
          11.
          		 Do not save 'next block header' when we cache hfileblocks Sub-task Resolved Michael Stack
          12.
          		 L1 cache doesn't give fair warning that it is showing partial stats only when it hits limit Sub-task Resolved Michael Stack
          13.
          		 Port HBASE-10205 (ConcurrentModificationException in BucketAllocator) to branch-1 Sub-task Closed Stephen Yuan Jiang
          14.
          		 Backport "HBASE-15477 Do not save 'next block header' when we cache hfileblocks" Sub-task Resolved Michael Stack
          15.
          		 BucketCache startup is slow Sub-task Resolved ramkrishna.s.vasudevan
          16.
          		 BucketCache is inefficient/wasteful/dumb in its bucket allocations Sub-task Open Unassigned
          17.
          		 Reduce the heap overhead for BucketCache Sub-task Resolved Anoop Sam John
          18.
          		 Investigate why bucket cache filling up in file mode in an exisiting file is slower Sub-task Resolved ramkrishna.s.vasudevan
          19.
          		 BucketCache reduce heap overhead : Investigate removal of NavigableSet 'blocksByHFile' Sub-task Open Anoop Sam John

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              18 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: