Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
4.3.0
-
None
-
None
-
- Hadoop 3 alpha 4
- HDFS HA
- log aggregation turned on
Description
In a secure environment, when both HDFS HA and log aggregation are turned on, JavaActionExecutor is not able to call YarnClient#submitApplication since HDFS_DELEGATION_TOKEN is missing.
In those cases we need to get HDFS_DELEGATION_TOKEN from YARN:
- get server principal / YARN renewer via HadoopAccessorService#getServerPrincipal
- get HDFS_DELEGATION_TOKEN via DFSClient#getDelegationToken
- add HDFS_DELEGATION_TOKEN to Credentials
Attachments
Attachments
Issue Links
- links to