Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8809

Include deletes in the scan (setRaw) method does not respect the time range or the filter

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.98.0, 0.95.2, 0.94.10
    • Scanners
    • None
    • Reviewed
    • Hide
      "Raw" scans (Scan.setRaw(true)), now honor the scan's time range if specified.
      Previously the time range would be ignored.
      Show
      "Raw" scans (Scan.setRaw(true)), now honor the scan's time range if specified. Previously the time range would be ignored.

    Description

      If a row has been deleted at time stamp 'T' and a scan with time range (0, T-1) is executed, it still returns the delete marker at time stamp 'T'. It is because of the code in ScanQueryMatcher.java

            if (retainDeletesInOutput
                || (!isUserScan && (EnvironmentEdgeManager.currentTimeMillis() - timestamp) <= timeToPurgeDeletes)
                || kv.getMemstoreTS() > maxReadPointToTrackVersions) {
              // always include or it is not time yet to check whether it is OK
              // to purge deltes or not
              return MatchCode.INCLUDE;
            }
      

      The assumption is scan (even with setRaw is set to true) should respect the filters and the time range specified.

      Please let me know if you think this behavior can be changed so that I can provide a patch for it.

      Attachments

        1. 8806-trunk-addendum.txt
          4 kB
          Lars Hofhansl
        2. 8809-0.94.txt
          4 kB
          Lars Hofhansl
        3. 8809-trunk.txt
          3 kB
          Lars Hofhansl
        4. DeleteMarkers.doc
          21 kB
          Vasu Mariyala
        5. hbase-8809-0.94-addendum-example.patch
          2 kB
          Jesse Yates
        6. hbase-8809-addendum-0.94-v0.patch
          4 kB
          Jesse Yates

        Activity

          People

            larsh Lars Hofhansl
            vasu.mariyala@gmail.com Vasu Mariyala
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: