[OOZIE-2049] got exception while using Hive2Credentials

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Affects Version/s: 4.0.0
• Component/s: security

Environment

CDH5.2 + CM + Kerberos

• Assignee: Unassigned
• Reporter: Andrejs Dubovskis
• Created: 29/Oct/14 12:19
• Updated: 22/Jun/21 14:50
• Resolved: 22/Jun/21 14:50

Description

workflow.xml contains has hive2 credentials and java action links to it.
oozie-site.xml mentions hive2 in oozie.credentials.credentialclasses

2014-10-29 12:11:03,765 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Get credential 'hive2auth' properties for action : 0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Name: hbaseauth, Type: hbase
2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Name: hive2auth, Type: hive2
2014-10-29 12:11:03,774 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Properties name :'hive2.server.principal', Value : 'impala/[e-mail]'
2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] getCredProperties: Properties name :'hive2.jdbc.url', Value : 'jdbc:hive2://idctst050:21050/'
2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Credential Properties set for action : 0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat
2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property : 'hive2.server.principal', value : 'impala/[e-mail]'
2014-10-29 12:11:03,775 DEBUG org.apache.oozie.action.hadoop.JavaActionExecutor: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] property : 'hive2.jdbc.url', value : 'jdbc:hive2://idctst050:21050/'
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Credentials Provider is created for Type: hive2
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hcat=org.apache.oozie.action.hadoop.HCatCredentials
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hcat', class Name : 'org.apache.oozie.action.hadoop.HCatCredentials'
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hbase=org.apache.oozie.action.hadoop.HbaseCredentials
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hbase', class Name : 'org.apache.oozie.action.hadoop.HbaseCredentials'
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential class for : hive2=org.apache.oozie.action.hadoop.Hive2Credentials
2014-10-29 12:11:03,776 DEBUG org.apache.oozie.action.hadoop.CredentialsProvider: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000000-141024125828670-oozie-oozi-W] ACTION[0000000-141024125828670-oozie-oozi-W@LogWorkflowStart] Creating Credential type : 'hive2', class Name : 'org.apache.oozie.action.hadoop.Hive2Credentials'
2014-10-29 12:11:03,787 DEBUG org.apache.thrift.transport.TSaslClientTransport: SERVER[idctst054] Sending mechanism name GSSAPI and initial response of length 656
2014-10-29 12:11:04,105 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Connected successfully to jdbc:hive2://idctst050:21050/;principal=impala/[e-mail]
2014-10-29 12:11:04,122 DEBUG org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Got token
2014-10-29 12:11:04,138 WARN org.apache.oozie.action.hadoop.Hive2Credentials: SERVER[idctst054] USER[catalyst] GROUP[-] TOKEN[] APP[${appName}] JOB[0000004-141024125828670-oozie-oozi-W] ACTION[0000004-141024125828670-oozie-oozi-W@UpdateImpalaCat] Exception in addtoJobConf
java.lang.NullPointerException
        at org.apache.hadoop.security.token.Token.decodeWritable(Token.java:256)
        at org.apache.hadoop.security.token.Token.decodeFromUrlString(Token.java:275)
        at org.apache.oozie.action.hadoop.Hive2Credentials.addtoJobConf(Hive2Credentials.java:70)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.setCredentialTokens(JavaActionExecutor.java:1054)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:914)
        at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1135)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:228)
        at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:63)
        at org.apache.oozie.command.XCommand.call(XCommand.java:281)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:323)
        at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:252)
        at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:174)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)