Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14576

New HFile version for optimized reverse scans

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      A new ticket to finish the work from HBASE-14283, which will fix the HFileReader seekBefore() previous block size calculation bug but make the resulting reverse scan take more I/O than a forward scan.

      Fixing the bug in the long term requires an HFile version bump, either major or minor. We will put the previous block's size in the HFileBlock header instead of trying to calculate it directly using block offset arithmetic.

      Per Anoop Sam John's suggestion, I created this ticket so that we can separate the issue of fixing the bug (the responsibility of HBASE-14283) and the issue of getting reverse scans to run quickly (the responsibility of this ticket). It is also unlikely that this ticket will be backported to old versions of HBase eg 0.98 whereas HBASE-14283 can be.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                benlau Ben Lau
                Reporter:
                benlau Ben Lau
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated: