[AMBARI-25932] wrong config file name in spark service advisor

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: trunk
• Component/s: ambari-server
• Assignee: caijialiang
• Reporter: caijialiang
• Created: 06/May/23 02:10
• Updated: 04/Sep/23 01:34
• Resolved: 25/May/23 09:27

Description

When using Spark 3.x, the "spark-defaults.conf" file is required to configure the Spark cluster, instead of "spark-default.xml" or "spark2-default.xml". In Ambari 2.8, all configurations for the Spark service are in the "spark-defaults.conf" file. However, the service advisor is still based on Spark 2, so the default Spark configuration file needs to be changed from "spark2-default" to "spark-default".

In addition, in Ambari 2.8, the Spark 3 Thrift Server also uses "spark-defaults.conf" at startup, so the "spark2-thrift-sparkconf" configuration in the advisor needs to be deprecated.

Issue Links

• Blocked: AMBARI-26001 ambari2.8 release
• links to: GitHub PR#3695