Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14782

FuzzyRowFilter skips valid rows

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 1.2.0, 1.3.0, 1.1.3, 0.98.17, 2.0.0
    • Filters
    • None

    Description

      The issue may affect not only master branch, but previous releases as well.
      This is from one of our customers:

      We are experiencing a problem with the FuzzyRowFilter for HBase scan. We think that it is a bug.
      Fuzzy filter should pick a row if it matches filter criteria irrespective of other rows present in table but filter is dropping a row depending on some other row present in table.

      Details/Step to reproduce/Sample outputs below:

      Missing row key: \x9C\x00\x044\x00\x00\x00\x00
      Causing row key: \x9C\x00\x03\xE9e\xBB{X\x1Fwts\x1F\x15vRX

      Prerequisites
      1. Create a test table. HBase shell command – create 'fuzzytest','d'
      2. Insert some test data. HBase shell commands:
      • put 'fuzzytest',"\x9C\x00\x044\x00\x00\x00\x00",'d:a','junk'
      • put 'fuzzytest',"\x9C\x00\x044\x01\x00\x00\x00",'d:a','junk'
      • put 'fuzzytest',"\x9C\x00\x044\x00\x01\x00\x00",'d:a','junk'
      • put 'fuzzytest',"\x9C\x00\x044\x00\x00\x01\x00",'d:a','junk'
      • put 'fuzzytest',"\x9C\x00\x044\x00\x01\x00\x01",'d:a','junk'
      • put 'fuzzytest',"\x9B\x00\x044e\xBB\xB2\xBB",'d:a','junk'
      • put 'fuzzytest',"\x9D\x00\x044e\xBB\xB2\xBB",'d:a','junk'
      Now when you run the code, you will find \x9C\x00\x044\x00\x00\x00\x00 in output because it matches filter criteria. (Refer how to run code below)
      Insert the row key causing bug:
      HBase shell command: put 'fuzzytest',"\x9C\x00\x03\xE9e\xBB{X\x1Fwts\x1F\x15vRX",'d:a','junk'
      Now when you run the code, you will not find \x9C\x00\x044\x00\x00\x00\x00 in output even though it still matches filter criteria.

      Verified the issue on master.

      Attachments

        1. HBASE-14782.patch
          5 kB
          Heng Chen
        2. HBASE-14782.patch
          5 kB
          Heng Chen
        3. HBASE-14782-v3.patch
          5 kB
          Vladimir Rodionov
        4. HBASE-14782-v4.patch
          5 kB
          Vladimir Rodionov
        5. HBASE-14782-0.98-v4.patch
          5 kB
          Vladimir Rodionov

        Activity

          People

            vrodionov Vladimir Rodionov
            vrodionov Vladimir Rodionov
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: