[HIVE-24204] LLAP: Invalid TEZ Job token in multi fragment query

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.0
• Component/s: llap
• Labels: pull-request-available
• Assignee: Yuriy Baltovskyy
• Reporter: Yuriy Baltovskyy
• Due: 30/Sep/20
• Created: 28/Sep/20 09:35
• Updated: 05/Dec/20 00:48

Description

When using LLAP server in the Kerberized environment and submitting the query via LLAP client that is planned as multi fragment (multiple splits), the following error occurs and the query fails:

org.apache.hadoop.ipc.Server: javax.security.sasl.SaslException: DIGEST-MD5: digest response format violation. Mismatched response.

This occurs because each split uses its own connection to LLAP server and its own TEZ job token while LLAP server stores only one token binding it to the whole query and not the separate fragment. When LLAP server communicates to the clients and uses the stored token, this causes Sasl exception due to using invalid token.

Issue Links

• links to: GitHub Pull Request #1530