HBase
  1. HBase
  2. HBASE-5986

Clients can see holes in the META table when regions are being split

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.92.1, 0.94.1, 0.95.2
    • Fix Version/s: 0.94.1, 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We found this issue when running large scale ingestion tests for HBASE-5754. The problem is that the .META. table updates are not atomic while splitting a region. In SplitTransaction, there is a time lap between the marking the parent offline, and adding of daughters to the META table. This can result in clients using MetaScanner, of HTable.getStartEndKeys (used by the TableInputFormat) missing regions which are made just offline, but the daughters are not added yet.

      This is also related to HBASE-4335.

      1. HBASE-5986-test_v1.patch
        11 kB
        Enis Soztutar
      2. 5986-v2.txt
        37 kB
        Ted Yu
      3. HBASE-5986_v3.patch
        39 kB
        Ted Yu
      4. HBASE-5986-0.92.patch
        38 kB
        Enis Soztutar
      5. HBASE-5986-0.94.patch
        37 kB
        Enis Soztutar

        Issue Links

          Activity

          Enis Soztutar created issue -
          Enis Soztutar made changes -
          Field Original Value New Value
          Attachment HBASE-5986-test_v1.patch [ 12526454 ]
          Ted Yu made changes -
          Attachment 5986-v2.txt [ 12527760 ]
          Ted Yu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hadoop Flags Reviewed [ 10343 ]
          Jeff Hammerbacher made changes -
          Link This issue is related to HBASE-5754 [ HBASE-5754 ]
          Ted Yu made changes -
          Attachment HBASE-5986_v3.patch [ 12528806 ]
          stack made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Resolution Fixed [ 1 ]
          Ted Yu made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Enis Soztutar made changes -
          Attachment HBASE-5986-0.92.patch [ 12529758 ]
          Attachment HBASE-5986-0.94.patch [ 12529759 ]
          Ted Yu made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Fix Version/s 0.92.2 [ 12319888 ]
          Fix Version/s 0.94.1 [ 12320257 ]
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.92.2 [ 12319888 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Fix Version/s 0.94.1 [ 12320257 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.1 [ 12320257 ]

            People

            • Assignee:
              Enis Soztutar
              Reporter:
              Enis Soztutar
            • Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development