[HIVE-26439] Skip collecting Kafka delegation tokens if PLAINTEXT is set

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-2
• Labels: pull-request-available
• Assignee: Yu-Wen Lai
• Reporter: Yu-Wen Lai
• Created: 31/Jul/22 23:29
• Updated: 16/Nov/22 13:50
• Resolved: 05/Aug/22 02:47

Description

For a kafka table, it can be pointed to a external unsecured Kafka cluster even hive is running in a secured cluster. In this case, tez will try to collect kafka delegation tokens, but failed with error messages as following.

java.lang.RuntimeException: Exception while getting kafka delegation tokens
at 
...
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.IllegalSaslStateException: Unexpected handshake request with client mechanism GSSAPI, enabled mechanisms are [] 

To resolve this issue, we can skip collecting kafka delegation tokens if "kafka.consumer.security.protocol" or "kafka.producer.security.protocol" is set to "PLAINTEXT" in tblproperties.

Issue Links

• links to: GitHub Pull Request #3488