Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-616

HBase import/export is not working on non secure cluster where security is available

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.4.3
    • Fix Version/s: 1.4.3
    • Component/s: hbase-integration
    • Labels:
      None

      Description

      HBase operations might fail on cluster with available security patches when security is off on following exception:

      12/09/21 02:52:05 ERROR security.UserGroupInformation: PriviledgedActionException as:jenkins (auth:SIMPLE) cause:org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: No matching handler for protocol org.apache.hadoop.hbase.security.token.AuthenticationProtocol in region .META.,,1
      	at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:4048)
      	at org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3156)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      	at java.lang.reflect.Method.invoke(Method.java:597)
      	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
      	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1345)
      
      1. SQOOP-616.patch
        2 kB
        Jarek Jarcec Cecho

        Activity

        Hide
        jarcec Jarek Jarcec Cecho added a comment -

        Maddineni Sukumar, I would suggest to send general inquires to the user mailing list rather than posting them on resolved JIRAs. You can find instructions how to sing up on our mailing list page.

        Show
        jarcec Jarek Jarcec Cecho added a comment - Maddineni Sukumar , I would suggest to send general inquires to the user mailing list rather than posting them on resolved JIRAs. You can find instructions how to sing up on our mailing list page .
        Hide
        sukunaidu@gmail.com Maddineni Sukumar added a comment -

        Hi, I am new to hbase with security on. We have enabled kerberos security in our hbase cluster and after that while running map reduce job I am getting below similar exception.

        13/09/20 12:14:15 [main] ERROR security.UserGroupInformation(1411): PriviledgedActionException as:hbase/some.domain.net@HOSTNAME.NET (auth:KERBEROS) cause:org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: No matching handler for protocol org.apache.hadoop.hbase.security.token.AuthenticationProtocol in region .META.,,1
        at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:5582)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3870)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:601)
        at org.apache.hadoop.hbase.ipc.SecureRpcEngine$Server.call(SecureRpcEngine.java:308)
        at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426)

        please correct me if I am doing any thing wrong or is there any fix for that....

        Thanks
        Sukumar

        Show
        sukunaidu@gmail.com Maddineni Sukumar added a comment - Hi, I am new to hbase with security on. We have enabled kerberos security in our hbase cluster and after that while running map reduce job I am getting below similar exception. 13/09/20 12:14:15 [main] ERROR security.UserGroupInformation(1411): PriviledgedActionException as:hbase/some.domain.net@HOSTNAME.NET (auth:KERBEROS) cause:org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: org.apache.hadoop.hbase.ipc.HBaseRPC$UnknownProtocolException: No matching handler for protocol org.apache.hadoop.hbase.security.token.AuthenticationProtocol in region .META.,,1 at org.apache.hadoop.hbase.regionserver.HRegion.exec(HRegion.java:5582) at org.apache.hadoop.hbase.regionserver.HRegionServer.execCoprocessor(HRegionServer.java:3870) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.hadoop.hbase.ipc.SecureRpcEngine$Server.call(SecureRpcEngine.java:308) at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1426) please correct me if I am doing any thing wrong or is there any fix for that.... Thanks Sukumar
        Hide
        cheolsoo Cheolsoo Park added a comment -

        Committed to trunk. Thanks Jarcec!

        Show
        cheolsoo Cheolsoo Park added a comment - Committed to trunk. Thanks Jarcec!
        Hide
        jarcec Jarek Jarcec Cecho added a comment - - edited

        I'm attaching my patch for review here as I'm having difficulties to upload my patch to review board.

        I've done following testing:

        • ant test -Dhadoopversion= {20,100}
        • Hadoop 2.0.0 based cluster with security on
        • Hadoop 2.0.0 based cluster with security off
        Show
        jarcec Jarek Jarcec Cecho added a comment - - edited I'm attaching my patch for review here as I'm having difficulties to upload my patch to review board. I've done following testing: ant test -Dhadoopversion= {20,100} Hadoop 2.0.0 based cluster with security on Hadoop 2.0.0 based cluster with security off

          People

          • Assignee:
            jarcec Jarek Jarcec Cecho
            Reporter:
            jarcec Jarek Jarcec Cecho
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development