HBase
  1. HBase
  2. HBASE-6963

unable to run hbck on a secure cluster

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: hbck
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      12/10/02 11:49:07 WARN util.HBaseFsck: Got AccessControlException when preCheckPermission 
      org.apache.hadoop.security.AccessControlException: Permission denied: action=WRITE path=hdfs://...:8020/hbase/-ROOT- user=hbase/...
      	at org.apache.hadoop.hbase.util.FSUtils.checkAccess(FSUtils.java:882)
      	at org.apache.hadoop.hbase.util.HBaseFsck.preCheckPermission(HBaseFsck.java:1230)
      	at org.apache.hadoop.hbase.util.HBaseFsck.exec(HBaseFsck.java:3343)
      	at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3205)
      

        Activity

        stack made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Hide
        stack added a comment -

        Marking closed.

        Show
        stack added a comment - Marking closed.
        stack made changes -
        Fix Version/s 0.98.0 [ 12323143 ]
        stack made changes -
        Fix Version/s 0.98.0 [ 12323143 ]
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94-security-on-Hadoop-23 #12 (See https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/12/)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978)

        Result = FAILURE
        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java

        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-0.94-security-on-Hadoop-23 #12 (See https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/12/ ) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978) Result = FAILURE tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        stack made changes -
        Fix Version/s 0.95.0 [ 12324094 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94-security #110 (See https://builds.apache.org/job/HBase-0.94-security/110/)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978)

        Result = SUCCESS
        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java

        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-0.94-security #110 (See https://builds.apache.org/job/HBase-0.94-security/110/ ) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978) Result = SUCCESS tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94 #840 (See https://builds.apache.org/job/HBase-0.94/840/)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405)

        Result = SUCCESS
        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-0.94 #840 (See https://builds.apache.org/job/HBase-0.94/840/ ) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Revision 1445405) Result = SUCCESS tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Hide
        Hudson added a comment -

        Integrated in HBase-0.94 #836 (See https://builds.apache.org/job/HBase-0.94/836/)
        HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978)

        Result = SUCCESS
        tedyu :
        Files :

        • /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-0.94 #836 (See https://builds.apache.org/job/HBase-0.94/836/ ) HBASE-7814 Port HBASE-6963 'unable to run hbck on a secure cluster' to 0.94 (Sergey) (Revision 1444978) Result = SUCCESS tedyu : Files : /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #217 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/217/)
        HBASE-6963 unable to run hbck on a secure cluster (Revision 1396810)

        Result = FAILURE
        jxiang :
        Files :

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #217 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/217/ ) HBASE-6963 unable to run hbck on a secure cluster (Revision 1396810) Result = FAILURE jxiang : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Hide
        Hudson added a comment -

        Integrated in HBase-TRUNK #3441 (See https://builds.apache.org/job/HBase-TRUNK/3441/)
        HBASE-6963 unable to run hbck on a secure cluster (Revision 1396810)

        Result = FAILURE
        jxiang :
        Files :

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Show
        Hudson added a comment - Integrated in HBase-TRUNK #3441 (See https://builds.apache.org/job/HBase-TRUNK/3441/ ) HBASE-6963 unable to run hbck on a secure cluster (Revision 1396810) Result = FAILURE jxiang : Files : /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
        Jimmy Xiang made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 0.96.0 [ 12320040 ]
        Resolution Fixed [ 1 ]
        Hide
        Jimmy Xiang added a comment -

        Thanks Jon for the review. Integrated into trunk.

        Show
        Jimmy Xiang added a comment - Thanks Jon for the review. Integrated into trunk.
        Hide
        Jimmy Xiang added a comment -

        Yes, I tested it on secure cluster. Good point. I just checked and found getShortUserName is on 0.22 version already, hasn't checked 0.20.x hadoops. Will commit to 0.96 only.

        Show
        Jimmy Xiang added a comment - Yes, I tested it on secure cluster. Good point. I just checked and found getShortUserName is on 0.22 version already, hasn't checked 0.20.x hadoops. Will commit to 0.96 only.
        Hide
        Jonathan Hsieh added a comment -

        Also, for the other versions we may need to change it to a warning instead of bailing out.

        Show
        Jonathan Hsieh added a comment - Also, for the other versions we may need to change it to a warning instead of bailing out.
        Hide
        Jonathan Hsieh added a comment - - edited

        +1 assuming you've tested on secure cluster. Please only put on trunk, since we aren't guaranteed that the getShortUserName() call is on the older 0.20.x hadoops, but present on 1.0+ (which 0.96 has as a lowest supported version).

        Show
        Jonathan Hsieh added a comment - - edited +1 assuming you've tested on secure cluster. Please only put on trunk, since we aren't guaranteed that the getShortUserName() call is on the older 0.20.x hadoops, but present on 1.0+ (which 0.96 has as a lowest supported version).
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12548448/trunk_6963.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.

        -1 javadoc. The javadoc tool appears to have generated 81 warning messages.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        -1 findbugs. The patch appears to introduce 5 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests:
        org.apache.hadoop.hbase.regionserver.TestSplitTransaction

        Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
        Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12548448/trunk_6963.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 hadoop2.0 . The patch compiles against the hadoop 2.0 profile. -1 javadoc . The javadoc tool appears to have generated 81 warning messages. +1 javac . The applied patch does not increase the total number of javac compiler warnings. -1 findbugs . The patch appears to introduce 5 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests: org.apache.hadoop.hbase.regionserver.TestSplitTransaction Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/3022//console This message is automatically generated.
        Jimmy Xiang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jimmy Xiang made changes -
        Field Original Value New Value
        Attachment trunk_6963.patch [ 12548448 ]
        Jimmy Xiang created issue -

          People

          • Assignee:
            Jimmy Xiang
            Reporter:
            Jimmy Xiang
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development