Hi Vinod Kumar Vavilapalli & Sangjin Lee,
Though the addendum patch fixes the TestDistributedShell issue in 2.7.2, it had impacts in ATSv2 branch. On further checking realized that in trunk and 2.7.2 , yarn.resourcemanager.system-metrics-publisher.enabled was not set to true in TestDistributedShell.setupInternal in but was required to be set in ATSv2 branch.
Further to rectify i faced following issues,
- In MiniYARNCluster RM servicewrapper is first added and then AHSwrapper, and also actual AHS service is started in a thread, so RM's will be using the wrong timelineclient address(port is zero) as AHS service is not yet initialized.
- In Timeline client Impl's serviceInit URI for timeline REST service is set. So even though we create the correct service order (as per previous step), RM's SMP will fail to publish, as timelineweb address is got only after the AHS service is started.
Even after this (though got the right port) was still facing some issues.
So if MINI YARN cluster is required to be used with system-metrics-publisher enabled, either we need to start correcting series of issues or use other simpler option ServerSocketUtil.getPort(9188, 10), which i feel is safer and used in many other places.But would req different patches for 2.6.2 !