Description
In Ambari 2.2.0 few Spark properties were removed. This is because HDP 2.3.4 (Spark 1.5+) self-detects hdp version.
spark.driver.extraJavaOptions -Dhdp.version=
spark.yarn.am.extraJavaOptions -Dhdp.version=
However, removing these properties causes Ambari 2.2.0 + HDP 2.3.2 (Spark 1.4) to break as those properties were required.
This JIRA is to address this backward compatibility issue with HDP 2.3.2 and below caused after upgrading to Ambari 2.2.0
Attachments
Attachments
Issue Links
- is duplicated by
-
AMBARI-17244 Ambari 2.2.0 breaks backward compatibility with HDP 2.3.2 and below due to spark configs with hdp.version being removed
- Resolved
- links to