Follow the discussion in this PR, some client side config options should not be taken into the cluster. Once it takes effect, it will cause some issue(e.g.
For K8s deployment, we have explicitly remove KubernetesConfigOptions.KUBE_CONFIG_FILE and DeploymentOptionsInternal.CONF_DIR.
For Yarn deployment, we have at least two options DeploymentOptionsInternal.CONF_DIR and YarnConfigOptionsInternal.APPLICATION_LOG_CONFIG_FILE could be removed in client side.
Benefit from this, we could avoid some unexpected configuration loading or secret issues. Also we could avoid the logs in the jobmanager confusing the users since it is a client local path.