HBase
  1. HBase
  2. HBASE-4277

HRS.closeRegion should be able to close regions with only the encoded name

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.90.4
    • Fix Version/s: 0.90.5
    • Component/s: None
    • Labels:
      None

      Description

      As suggested by Stack in HBASE-4217 creating a new issue to provide a patch for 0.90.x version.

      We had some sort of an outage this morning due to a few racks losing power, and some regions were left in the following state:

      ERROR: Region UNKNOWN_REGION on sv4r17s9:60020, key=e32bbe1f48c9b3633c557dc0291b90a3, not on HDFS or in META but deployed on sv4r17s9:60020

      That region was deleted by the master but the region server never got the memo. Right now there's no way to force close it because HRS.closeRegion requires an HRI and the only way to create one is to get it from .META. which in our case doesn't contain a row for that region. Basically we have to wait until that server is dead to get rid of the region and make hbck happy.

      The required change is to have closeRegion accept an encoded name in both HBA (when the RS address is provided) and HRS since it's able to find it anyways from it's list of live regions.

      If a 0.90 version, we maybe should do that in another issue.

      1. HBASE-4277_0.90.patch
        16 kB
        ramkrishna.s.vasudevan

        Issue Links

          Activity

          ramkrishna.s.vasudevan created issue -
          ramkrishna.s.vasudevan made changes -
          Field Original Value New Value
          Link This issue incorporates HBASE-4217 [ HBASE-4217 ]
          ramkrishna.s.vasudevan made changes -
          Attachment HBASE-4277_0.90.patch [ 12492063 ]
          ramkrishna.s.vasudevan made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          ramkrishna.s.vasudevan made changes -
          Description As suggested by Stack in HBASE-4217 creating a new issue to proved a patch for 0.90.x version.


          We had some sort of an outage this morning due to a few racks losing power, and some regions were left in the following state:

          ERROR: Region UNKNOWN_REGION on sv4r17s9:60020, key=e32bbe1f48c9b3633c557dc0291b90a3, not on HDFS or in META but deployed on sv4r17s9:60020

          That region was deleted by the master but the region server never got the memo. Right now there's no way to force close it because HRS.closeRegion requires an HRI and the only way to create one is to get it from .META. which in our case doesn't contain a row for that region. Basically we have to wait until that server is dead to get rid of the region and make hbck happy.

          The required change is to have closeRegion accept an encoded name in both HBA (when the RS address is provided) and HRS since it's able to find it anyways from it's list of live regions.
          bq.If a 0.90 version, we maybe should do that in another issue.
          As suggested by Stack in HBASE-4217 creating a new issue to provide a patch for 0.90.x version.


          We had some sort of an outage this morning due to a few racks losing power, and some regions were left in the following state:

          ERROR: Region UNKNOWN_REGION on sv4r17s9:60020, key=e32bbe1f48c9b3633c557dc0291b90a3, not on HDFS or in META but deployed on sv4r17s9:60020

          That region was deleted by the master but the region server never got the memo. Right now there's no way to force close it because HRS.closeRegion requires an HRI and the only way to create one is to get it from .META. which in our case doesn't contain a row for that region. Basically we have to wait until that server is dead to get rid of the region and make hbck happy.

          The required change is to have closeRegion accept an encoded name in both HBA (when the RS address is provided) and HRS since it's able to find it anyways from it's list of live regions.
          bq.If a 0.90 version, we maybe should do that in another issue.
          stack made changes -
          Priority Major [ 3 ] Critical [ 2 ]
          stack made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          stack made changes -
          Fix Version/s 0.92.0 [ 12314223 ]
          ramkrishna.s.vasudevan made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Fix Version/s 0.90.6 [ 12319200 ]
          Fix Version/s 0.90.5 [ 12317145 ]
          stack made changes -
          Fix Version/s 0.90.5 [ 12317145 ]
          Fix Version/s 0.90.6 [ 12319200 ]

            People

            • Assignee:
              ramkrishna.s.vasudevan
              Reporter:
              ramkrishna.s.vasudevan
            • Votes:
              1 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development