Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2049

got exception while using Hive2Credentials

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 4.0.0
    • Fix Version/s: None
    • Component/s: security
    • Labels:
      None
    • Environment:

      CDH5.2 + CM + Kerberos

      Description

      workflow.xml contains has hive2 credentials and java action links to it.
      oozie-site.xml mentions hive2 in oozie.credentials.credentialclasses

      2014-10-29 12:11:03,765 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Get credential 'hive2auth' properties for action : 0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
      2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Name: hbaseauth, Type: hbase
      2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Name: hive2auth, Type: hive2
      2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Properties name :'hive2.server.principal', Value : 'impala/idctst050@CATALYST-TEST.REALM'
      2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Properties name :'hive2.jdbc.url', Value : 'jdbc:hive2://idctst050:21050/'
      2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Credential Properties set for action : 0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
      2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property : 'hive2.server.principal', value : 'impala/idctst050@CATALYST-TEST.REALM'
      2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property : 'hive2.jdbc.url', value : 'jdbc:hive2://idctst050:21050/'
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Credentials Provider is created for Type: hive2
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hcat=org.apache.oozie.action.hadoop.HCatCredentials
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hcat', class Name : 'org.apache.oozie.action.hadoop.HCatCredentials'
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hbase=org.apache.oozie.action.hadoop.HbaseCredentials
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hbase', class Name : 'org.apache.oozie.action.hadoop.HbaseCredentials'
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hive2=org.apache.oozie.action.hadoop.Hive2Credentials
      2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hive2', class Name : 'org.apache.oozie.action.hadoop.Hive2Credentials'
      2014-10-29 12:11:03,787 DEBUG org.apache.thrift.transport.TSaslClientTransport: SERVER[idctst054] Sending mechanism name GSSAPI and initial response of length 656
      2014-10-29 12:11:04,105 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Connected successfully to jdbc:hive2://idctst050:21050/;principal=impala/idctst050@CATALYST-TEST.REALM
      2014-10-29 12:11:04,122 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Got token
      2014-10-29 12:11:04,138 WARN org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Exception in addtoJobConf
      java.lang.NullPointerException
              at org.apache.hadoop.security.token.Token.decodeWritable(Token.java:256)
              at org.apache.hadoop.security.token.Token.decodeFromUrlString(Token.java:275)
              at org.apache.oozie.action.hadoop.Hive2Credentials.addtoJobConf(Hive2Credentials.java:70)
              at org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1054)
              at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:914)
              at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
              at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
              at org.apache.oozie.command.XCommand.call(XCommand.java:281)
              at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
              at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
              at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:745)
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              dubislv Andrejs Dubovskis
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: