HBase
  1. HBase
  2. HBASE-5599

[hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.90.6
    • Fix Version/s: 0.94.0, 0.95.0
    • Component/s: hbck
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The hbck tool can not fix the six scenarios.
      1. Version file does not exist in root dir.
      Fix: I try to create a version file by 'FSUtils.setVersion' method.

      2. [REGIONNAME][KEY] on HDFS, but not listed in META or deployed on any region server.
      Fix: I get region info form the hdfs file, this region info write to '.META.' table.

      3. [REGIONNAME][KEY] not in META, but deployed on [SERVERNAME]
      Fix: I get region info form the hdfs file, this region info write to '.META.' table.

      4. [REGIONNAME] should not be deployed according to META, but is deployed on [SERVERNAME]
      Fix: Close this region.

      5. First region should start with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
      Fix: The region info is not in hdfs and .META., so it create a empty region for this error.

      6. There is a hole in the region chain between [KEY] and [KEY]. You need to create a new regioninfo and region dir in hdfs to plug the hole.
      Fix: The region info is not in hdfs and .META., so it create a empty region for this hole.

      1. hbase-5599-0.90.patch
        11 kB
        fulin wang
      2. hbase-5599-0.90_v2.patch
        16 kB
        fulin wang
      3. hbase-5599-0.90_v3.patch
        15 kB
        fulin wang
      4. hbase-5599-0.90_v5.patch
        2 kB
        fulin wang
      5. hbase-5599-0.92_v5.patch
        3 kB
        fulin wang
      6. hbase-5599-0.94_v5.patch
        3 kB
        fulin wang
      7. hbase-5599-trunk_v5.patch
        3 kB
        fulin wang
      8. hbase-5599-0.90_v6.patch
        8 kB
        fulin wang
      9. hbase-5599-0.90_v7.patch
        12 kB
        fulin wang
      10. hbase-5599-trunk_v7.patch
        12 kB
        fulin wang
      11. 0.90-surefire-report-hbck.html
        204 kB
        fulin wang
      12. license.png
        234 kB
        Jonathan Hsieh
      13. hbase-5599-0.90_v8
        12 kB
        fulin wang
      14. hbase-5599-trunk_v8.patch
        12 kB
        fulin wang
      15. hbase-5599-92-v8.patch
        12 kB
        Jonathan Hsieh

        Issue Links

          Activity

          Lars Hofhansl made changes -
          Fix Version/s 0.94.0 [ 12316419 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.94.0 [ 12316419 ]
          Fix Version/s 0.90.7 [ 12319481 ]
          Fix Version/s 0.92.2 [ 12319888 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Lars Hofhansl made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Jonathan Hsieh made changes -
          Attachment hbase-5599-92-v8.patch [ 12522278 ]
          Jonathan Hsieh made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 0.90.7 [ 12319481 ]
          Fix Version/s 0.92.2 [ 12319888 ]
          Fix Version/s 0.94.0 [ 12316419 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Resolution Fixed [ 1 ]
          Jonathan Hsieh made changes -
          Comment [ -1 overall. Here are the results of testing the latest attachment
            http://issues.apache.org/jira/secure/attachment/12522208/license.png
            against trunk revision .

              +1 @author. The patch does not contain any @author tags.

              -1 tests included. The patch doesn't appear to include any new or modified tests.
                                  Please justify why no new tests are needed for this patch.
                                  Also please list what manual steps were performed to verify this patch.

              -1 patch. The patch command could not apply the patch.

          Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/1472//console

          This message is automatically generated. ]
          fulin wang made changes -
          Attachment hbase-5599-0.90_v8 [ 12522214 ]
          Attachment hbase-5599-trunk_v8.patch [ 12522215 ]
          Jonathan Hsieh made changes -
          Attachment license.png [ 12522208 ]
          Jonathan Hsieh made changes -
          Summary The hbck tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, SHOULD_NOT_BE_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN. [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies
          Fix Version/s 0.90.6 [ 12319200 ]
          fulin wang made changes -
          Attachment hbase-5599-0.90_v7.patch [ 12521929 ]
          Attachment hbase-5599-trunk_v7.patch [ 12521930 ]
          Attachment 0.90-surefire-report-hbck.html [ 12521931 ]
          Jonathan Hsieh made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Assignee fulin wang [ fulin ]
          fulin wang made changes -
          Attachment hbase-5599-0.90_v6.patch [ 12520573 ]
          fulin wang made changes -
          Attachment hbase-5599-0.92_v5.patch [ 12520098 ]
          Attachment hbase-5599-0.94_v5.patch [ 12520099 ]
          Attachment hbase-5599-trunk_v5.patch [ 12520100 ]
          fulin wang made changes -
          Attachment hbase-5599-0.90_v5.patch [ 12520078 ]
          Jonathan Hsieh made changes -
          Summary The hbkc tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, SHOULD_NOT_BE_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN. The hbck tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, SHOULD_NOT_BE_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN.
          fulin wang made changes -
          Attachment hbase-5599-0.90_v3.patch [ 12519580 ]
          fulin wang made changes -
          Attachment hbase-5599-0.90_v2.patch [ 12519067 ]
          fulin wang made changes -
          Summary The hbck tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, NOT_IN_HDFS_OR_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN. The hbkc tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, SHOULD_NOT_BE_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN.
          fulin wang made changes -
          Summary The hbkc tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, NOT_IN_HDFS_OR_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN. The hbck tool can not fix the six scenarios, it is NO_VERSION_FILE, NOT_IN_META_OR_DEPLOYED, NOT_IN_META, NOT_IN_HDFS_OR_DEPLOYED, FIRST_REGION_STARTKEY_NOT_EMPTY, HOLE_IN_REGION_CHAIN.
          Description The hbkc tool can not fix the six scenarios.
          1. Version file does not exist in root dir.
             Fix: I try to create a version file by 'FSUtils.setVersion' method.
             
          2. [REGIONNAME][KEY] on HDFS, but not listed in META or deployed on any region server.
             Fix: I get region info form the hdfs file, this region info write to '.META.' table.
             
          3. [REGIONNAME][KEY] not in META, but deployed on [SERVERNAME]
             Fix: I get region info form the hdfs file, this region info write to '.META.' table.
             
          4. [REGIONNAME] should not be deployed according to META, but is deployed on [SERVERNAME]
             Fix: Close this region.
             
          5. First region should start with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
             Fix: The region info is not in hdfs and .META., so it create a empty region for this error.

          6. There is a hole in the region chain between [KEY] and [KEY]. You need to create a new regioninfo and region dir in hdfs to plug the hole.
            Fix: The region info is not in hdfs and .META., so it create a empty region for this hole.
            
          The hbck tool can not fix the six scenarios.
          1. Version file does not exist in root dir.
             Fix: I try to create a version file by 'FSUtils.setVersion' method.
             
          2. [REGIONNAME][KEY] on HDFS, but not listed in META or deployed on any region server.
             Fix: I get region info form the hdfs file, this region info write to '.META.' table.
             
          3. [REGIONNAME][KEY] not in META, but deployed on [SERVERNAME]
             Fix: I get region info form the hdfs file, this region info write to '.META.' table.
             
          4. [REGIONNAME] should not be deployed according to META, but is deployed on [SERVERNAME]
             Fix: Close this region.
             
          5. First region should start with an empty key. You need to create a new region and regioninfo in HDFS to plug the hole.
             Fix: The region info is not in hdfs and .META., so it create a empty region for this error.

          6. There is a hole in the region chain between [KEY] and [KEY]. You need to create a new regioninfo and region dir in hdfs to plug the hole.
            Fix: The region info is not in hdfs and .META., so it create a empty region for this hole.
            
          Ted Yu made changes -
          Link This issue is related to HBASE-5128 [ HBASE-5128 ]
          fulin wang made changes -
          Attachment hbase-5599-0.90.patch [ 12518865 ]
          fulin wang made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          fulin wang made changes -
          Field Original Value New Value
          Status Open [ 1 ] Patch Available [ 10002 ]
          fulin wang created issue -

            People

            • Assignee:
              fulin wang
              Reporter:
              fulin wang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved:

                Development