Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15240 Go Big BucketCache Fixes
  3. HBASE-15713

Backport "HBASE-15477 Do not save 'next block header' when we cache hfileblocks"

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0
    • 1.3.0
    • BucketCache
    • None
    • Hide
      (Release note has been ported from the master issue -- with an addendum)

      Fix over-persisting in blockcache; no longer save the block PLUS the header of the next block (3 bytes) when writing the cache.

      Also removes support for hfileblock v1; hfile block v1 was used writing hfile v1. hfile v1 was the default in hbase before hbase-0.92. hbase.96 would not start unless all v1 hfiles had been compacted out of the cluster.

      This patch also removed the tests TestUpgradeTo96 and TestMetaMigrationConvertingToPB, tests deprecated since hbase-0.96 since they required support for hfile v1 (which this patch removes). HBASE-11611 removed these tests from master.
      Show
      (Release note has been ported from the master issue -- with an addendum) Fix over-persisting in blockcache; no longer save the block PLUS the header of the next block (3 bytes) when writing the cache. Also removes support for hfileblock v1; hfile block v1 was used writing hfile v1. hfile v1 was the default in hbase before hbase-0.92. hbase.96 would not start unless all v1 hfiles had been compacted out of the cluster. This patch also removed the tests TestUpgradeTo96 and TestMetaMigrationConvertingToPB, tests deprecated since hbase-0.96 since they required support for hfile v1 (which this patch removes). HBASE-11611 removed these tests from master.

    Description

      Backport "HBASE-15477 Do not save 'next block header' when we cache hfileblocks"

      The backport involves removing support for hfile v1/hfileblockv1 support which was our default before 0.92. The backport patch also removes tests that depended on hfile v1, tests that were deprecated post 0.96 and to be removed (0.96 was the release that would only run if the whole cluster was hfiles > v1).

      mantonov Ok to commit the above to 1.3? Thanks boss.

      Attachments

        1. 15477.backport.branch-1.v8.patch
          212 kB
          Michael Stack
        2. 15477.backport.branch-1.v7.patch
          180 kB
          Michael Stack

        Issue Links

          Activity

            People

              stack Michael Stack
              stack Michael Stack
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: