Description
mapreduce.job.send-token-conf is a useful feature in Hadoop (see YARN-5910 with which RM is not required to statically have config for all the secure HDFS clusters. Currently it only works for MRv2 but it'd be nice if Spark can also use this feature. I think we only need to pass the config to LaunchContainerContext in Client.createContainerLaunchContext.
Attachments
Issue Links
- causes
-
SPARK-39657 YARN AM client should call the non-static setTokensConf method
-
- Resolved
-
- is related to
-
YARN-5910 Support for multi-cluster delegation tokens
-
- Resolved
-
- links to