Minor Description
In order not to hardcode SHS web ui port and not duplicate information that is already configured we might be inclined to define spark.yarn.historyServer.address as
http://${hadoopconf-yarn.resourcemanager.hostname}:${spark.history.ui.port}
However, since spark.history.ui.port is not registered its resolution fails when it's not explicitly set in the deployed spark conf.
