[BIGTOP-3689] Upgrade Mpack services stack to Bigtop 3.2

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Flags: Important
• Assignee: Yuqi Gu
• Reporter: Yuqi Gu
• Created: 31/May/22 07:21
• Updated: 01/Dec/22 09:53
• Resolved: 01/Dec/22 09:53

Description

Currently Bigtop Mpack still just supports Bigtop-1.5 (Hadoop 2.x), but the Bigtop has already supported Hadoop 3.2.3 in Bigtop 3.1.0 release.

This task is to upgrade Bgtp-Mpack services from Bigtop-1.5 (Hadoop 2.x) to Bigtop-3.2 (Hadoop-3.3). 

Issue Links

• Is contained by: BIGTOP-3695 Define Bigtop 3.2 release BOM

Sub-Tasks

• Remove deprecated Hadoop fs-image file after uninstalling HDFS-namenode: Closed
• Update Yarn service configuration in Mpack: Resolved
• Refine the Ambari RPM spec to fix warning after rpm uninstallation: Closed
• Rename the Yarn/MapReduce historyserver PID file: Resolved
• Update MapReduce service configuration in Mpack: Resolved
• Fix MapReduce2 service-check in Amabri Mpack: Resolved
• Decouple Mpack HDFS services from Ambari Core: Resolved
• Add Kafka support for Bigtop 3.1.0 Mpack: Resolved
• Add ELK support for Bigtop 3.1.0 Mpack: Closed
• Align the version of the components in Mpack.: Resolved
• Add HBase support for Bigtop 3.1.0 Mpack: Resolved
• Docker dev/test env for centos7: Resolved
• Add Sqoop support for Bigtop 3.1.0 Mpack: Resolved
• Add Hive support for Bigtop 3.1.0 Mpack: Resolved
• Add Tez support for Bigtop 3.1.0 Mpack: Resolved
• Add Zeppelin support for Bigtop 3.1.0 Mpack: Resolved
• Add Flink support for Bigtop 3.1.0 Mpack: Resolved
• Add Chrony synchronization to fix hostcheck issue in Mpack docker provisioner: Resolved
• Add Solr support for Bigtop 3.1.0 Mpack: Resolved
• Add Spark support for Bigtop 3.1.0 Mpack: Resolved
• Add Ambari_metrics to Bigtop Mpack: Resolved
• Fix Ambari-HDFS components fail to start when kerberos enabled: Resolved
• Decouple Kerberos services from Ambari Core: Closed
• Mpack solr fail to start when kerberos enabled: Resolved
• Add extra Ambari-metrics RPMs packages in Ambari build for Mpack: Resolved
• Fix Mpack Hive fail to start when kerberos enabled: Resolved
• Add quicklinks for HDFS/YARN/MapReduce: Resolved
• Fails to enable NameNode HA: Resolved
• Use OSS version of Grafana for Ambari Metrics: Resolved