HBase
  1. HBase
  2. HBASE-10844

Coprocessor failure during batchmutation leaves the memstore datastructs in an inconsistent state

    Details

    • Hadoop Flags:
      Reviewed
    • Release Note:
      Promotes an -ea assert to logged FATAL and RS abort when memstore is found to be in an inconsistent state.

      Description

      Observed this in the testing with Phoenix. The test in Phoenix - MutableIndexFailureIT deliberately fails the batchmutation call via the installed coprocessor. But the update is not rolled back. That leaves the memstore inconsistent. In particular, I observed that getFlushableSize is updated before the coprocessor was called but the update is not rolled back. When the region is being closed at some later point, the assert introduced in HBASE-10514 in the HRegion.doClose() causes the RegionServer to shutdown abnormally.

      1. 10844-1.txt
        1 kB
        Devaraj Das
      2. 10844-1-0.98.txt
        1 kB
        Devaraj Das
      3. 10844-v2.patch
        1 kB
        Nick Dimiduk
      4. HBASE-10844.02.patch
        2 kB
        Nick Dimiduk
      5. HBASE-10844.02-branch-1.0.patch
        2 kB
        Nick Dimiduk
      6. HBASE-10844.02-0.98.patch
        2 kB
        Nick Dimiduk

        Activity

        Enis Soztutar made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Nick Dimiduk made changes -
        Fix Version/s 1.1.2 [ 12332793 ]
        Fix Version/s 1.1.3 [ 12333152 ]
        Andrew Purtell made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Assignee Devaraj Das [ devaraj ] Nick Dimiduk [ ndimiduk ]
        Resolution Fixed [ 1 ]
        Nick Dimiduk made changes -
        Release Note Promotes an {{-ea}} assert to RS abort when memstore is found to be in an inconsistent state. Promotes an -ea assert to logged FATAL and RS abort when memstore is found to be in an inconsistent state.
        Nick Dimiduk made changes -
        Release Note Promotes an {{-ea}} assert to RS abort when memstore is found to be in an inconsistent state.
        Nick Dimiduk made changes -
        Fix Version/s 2.0.0 [ 12327188 ]
        Fix Version/s 0.98.14 [ 12329715 ]
        Fix Version/s 1.0.2 [ 12329865 ]
        Fix Version/s 1.2.0 [ 12332062 ]
        Fix Version/s 1.3.0 [ 12332794 ]
        Fix Version/s 1.1.3 [ 12333152 ]
        Nick Dimiduk made changes -
        Attachment HBASE-10844.02.patch [ 12750401 ]
        Attachment HBASE-10844.02-branch-1.0.patch [ 12750402 ]
        Attachment HBASE-10844.02-0.98.patch [ 12750403 ]
        Nick Dimiduk made changes -
        Status Reopened [ 4 ] Patch Available [ 10002 ]
        Nick Dimiduk made changes -
        Attachment 10844-v2.patch [ 12749964 ]
        Devaraj Das made changes -
        Attachment 10844-1-0.98.txt [ 12683013 ]
        Devaraj Das made changes -
        Attachment 10844-1-0.98.txt [ 12683012 ]
        Devaraj Das made changes -
        Attachment 10844-1-0.98.txt [ 12683012 ]
        Devaraj Das made changes -
        Resolution Won't Fix [ 2 ]
        Status Resolved [ 5 ] Reopened [ 4 ]
        Andrew Purtell made changes -
        Fix Version/s 0.99.0 [ 12325675 ]
        Fix Version/s 0.98.2 [ 12326505 ]
        Fix Version/s 0.96.3 [ 12326538 ]
        Fix Version/s 0.94.20 [ 12326654 ]
        Devaraj Das made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Lars Hofhansl made changes -
        Fix Version/s 0.94.20 [ 12326654 ]
        Fix Version/s 0.94.19 [ 12326287 ]
        Anoop Sam John made changes -
        Fix Version/s 0.94.19 [ 12326287 ]
        Devaraj Das made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Devaraj Das made changes -
        Attachment 10844-1.txt [ 12637029 ]
        Andrew Purtell made changes -
        Field Original Value New Value
        Fix Version/s 0.99.0 [ 12325675 ]
        Fix Version/s 0.96.3 [ 12326538 ]
        Devaraj Das created issue -

          People

          • Assignee:
            Nick Dimiduk
            Reporter:
            Devaraj Das
          • Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development