[BIGTOP-3907] Spark History Server fails to start on CentOS7 aarch64

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Component/s: spark
• Assignee: Zhiguo Wu
• Reporter: Zhiguo Wu
• Created: 07/Feb/23 11:27
• Updated: 22/Apr/24 06:59

Description

Relates to: https://issues.apache.org/jira/browse/SPARK-42370

 

Except to fix dependency issue for Spark, we can simply remove aarch6 profile then compile leveldb and leveldbjni on our own just like Hadoop did on https://github.com/apache/bigtop/blob/release-3.2.0/bigtop-packages/src/common/hadoop/do-component-build#L53.

(PS: I tried to remove jline-2.4.16.jar manually, but I got another error says GLIBCXX version is too old, rather than install newer version of g++ on CentOS7, the solution used by Hadoop may be more easily to achieved)

Issue Links

• relates to: SPARK-42370 Spark History Server fails to start on CentOS7 aarch64
• links to: https://github.com/apache/bigtop/pull/1086