Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8521

Cells cannot be overwritten with bulk loaded HFiles

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.92.1
    • 0.94.13
    • None
    • None

    Description

      Let's say you have a pre-built HFile that contains a cell:

      ('rowkey1', 'family1', 'qual1', 1234L, 'value1')

      We bulk load this first HFile. Now, let's create a second HFile that contains a cell that overwrites the first:

      ('rowkey1', 'family1', 'qual1', 1234L, 'value2')

      That gets bulk loaded into the table, but the value that HBase bubbles up is still 'value1'.

      It seems that there's no way to overwrite a cell for a particular timestamp without an explicit put operation. This seems to be the case even after minor and major compactions happen.

      My guess is that this is pretty closely related to the sequence number work being done on the compaction algorithm via HBASE-7842, but I'm not sure if one of would fix the other.

      Attachments

        1. hfileDirs.tar.gz
          0.6 kB
          Jonathan Natkins
        2. HBASE-8521.diff
          6 kB
          Jonathan Natkins
        3. HBASE-8521-v0-0.94.patch
          23 kB
          Jean-Marc Spaggiari
        4. HBASE-8521-v1-0.94.patch
          24 kB
          Jean-Marc Spaggiari
        5. HBASE-8521-v2-0.94.patch
          28 kB
          Jean-Marc Spaggiari
        6. HBASE-8521-v3-0.94.patch
          27 kB
          Jean-Marc Spaggiari
        7. HBASE-8521-v4-0.94.patch
          27 kB
          Jean-Marc Spaggiari
        8. HBASE-8521-v4-addendum-0.94.patch
          1.0 kB
          Jean-Marc Spaggiari

        Issue Links

          Activity

            People

              jmspaggi Jean-Marc Spaggiari
              natty Jonathan Natkins
              Votes:
              5 Vote for this issue
              Watchers:
              20 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: