[AMBARI-21823] Spark2 Shuffle Configuration Property Not Configure After Upgrade From BigInsights

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.5.2
• Fix Version/s: 2.6.0
• Assignee: Jonathan Hurley
• Reporter: Yesha Vora
• Created: 27/Aug/17 01:37
• Updated: 30/Aug/17 15:09
• Resolved: 27/Aug/17 03:16

Description

Scenario:

• Upgrade ambari from Ambari 2.2.2.0 to 2.5.2.0
• Upgrade BI 420 from HDP 2.6.2.0
  In this upgrade scenario, Spark1 was upgraded from BI->HDP
  Spark2 was added after upgrade.
  In this cluster , it has Spark and Spark2 both.
  However, spark2 shuffle is not added to yarn.nodemanager.aux-services.

   <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle,spark_shuffle</value>
      </property>

Issue Links

• links to: ReviewBoard