[SPARK-37282] Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Spark Core, Tests
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 11/Nov/21 05:16
• Updated: 10/Feb/24 08:33
• Resolved: 11/Nov/21 07:03

Description

Java 17 officially support Apple Silicon.

• JEP 391: macOS/AArch64 Port
• https://bugs.openjdk.java.net/browse/JDK-8251280

Oracle Java, Azul Zulu, and Eclipse Temurin Java 17 supports Apple Silicon natively.

/Users/dongjoon/.jenv/versions/oracle17/bin/java: Mach-O 64-bit executable arm64
/Users/dongjoon/.jenv/versions/zulu17/bin/java: Mach-O 64-bit executable arm64
/Users/dongjoon/.jenv/versions/temurin17/bin/java: Mach-O 64-bit executable arm64

Since LevelDBJNI still doesn't support Apple Silicon natively, the test cases fail on M1.

Issue Links

• causes: SPARK-47021 Fix `kvstore` module to have explicit `commons-lang3` test dependency
• links to: [Github] Pull Request #34548 (dongjoon-hyun)
• links to: [Github] Pull Request #34576 (dongjoon-hyun)
• links to: [Github] Pull Request #34576 (dongjoon-hyun)
• links to: [Github] Pull Request #34648 (LuciferYang)