[AMBARI-21866] ATS Applications Do Not Move From Active to Done After Upgrade

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 2.6.0
• Assignee: Jonathan Hurley
• Reporter: Jonathan Hurley
• Created: 31/Aug/17 17:28
• Updated: 31/Aug/17 20:07
• Resolved: 31/Aug/17 19:52

Description

When running Tez jobs, it was noticed that after killing the applications, ATS would never move them from the active directory to the done directory. The YARN folks deep some technical investigation and determined that the reason for this was a combination of ATS 1.0 and 1.5 configurations co-existing after upgrading from BigInsights to HDP.

The upgrade auto-merge should have taken care of this for us, but it seems that 1 property was missing from the default stack BI 4.2 (even though it gets added on install through the UI).

grep -r --include "*.xml" "yarn.timeline-service.store-class" src/main/resources/stacks/BigInsights
src/main/resources/stacks/BigInsights/4.0/services/YARN/configuration/yarn-site.xml:    <name>yarn.timeline-service.store-class&lt;/name>
src/main/resources/stacks/BigInsights/4.2.5/services/YARN/configuration/yarn-site.xml:    <name>yarn.timeline-service.store-class&lt;/name>

BI 4.2.0 doesn't have this property, which causes the merge to fail. It doesn't inherit it from BI 4.0 either.

Issue Links

• links to: ReviewBoard