Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-8521

Cells cannot be overwritten with bulk loaded HFiles

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.92.1
    • Fix Version/s: 0.94.13
    • Component/s: None
    • Labels:
      None

      Description

      Let's say you have a pre-built HFile that contains a cell:

      ('rowkey1', 'family1', 'qual1', 1234L, 'value1')

      We bulk load this first HFile. Now, let's create a second HFile that contains a cell that overwrites the first:

      ('rowkey1', 'family1', 'qual1', 1234L, 'value2')

      That gets bulk loaded into the table, but the value that HBase bubbles up is still 'value1'.

      It seems that there's no way to overwrite a cell for a particular timestamp without an explicit put operation. This seems to be the case even after minor and major compactions happen.

      My guess is that this is pretty closely related to the sequence number work being done on the compaction algorithm via HBASE-7842, but I'm not sure if one of would fix the other.

        Attachments

        1. HBASE-8521.diff
          6 kB
          Jonathan Natkins
        2. HBASE-8521-v0-0.94.patch
          23 kB
          Jean-Marc Spaggiari
        3. HBASE-8521-v1-0.94.patch
          24 kB
          Jean-Marc Spaggiari
        4. HBASE-8521-v2-0.94.patch
          28 kB
          Jean-Marc Spaggiari
        5. HBASE-8521-v3-0.94.patch
          27 kB
          Jean-Marc Spaggiari
        6. HBASE-8521-v4-0.94.patch
          27 kB
          Jean-Marc Spaggiari
        7. HBASE-8521-v4-addendum-0.94.patch
          1.0 kB
          Jean-Marc Spaggiari
        8. hfileDirs.tar.gz
          0.6 kB
          Jonathan Natkins

          Issue Links

            Activity

              People

              • Assignee:
                jmspaggi Jean-Marc Spaggiari
                Reporter:
                natty Jonathan Natkins
              • Votes:
                5 Vote for this issue
                Watchers:
                20 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: