[SPARK-35527] Fix HiveExternalCatalogVersionsSuite to pass with Java 11

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL, Tests
• Assignee: Kousuke Saruta
• Reporter: Kousuke Saruta
• Created: 26/May/21 04:27
• Updated: 12/Dec/22 18:10
• Resolved: 26/May/21 08:21

Description

I'm personally checking whether all the tests pass with Java 11 for the current master and I found HiveExternalCatalogVersionsSuite fails.
The reason is that Spark 3.0.2 and 3.1.1 doesn't accept 2.3.8 as a hive metastore version.

HiveExternalCatalogVersionsSuite downloads Spark releases from https://dist.apache.org/repos/dist/release/spark/ and run test for each release. The Spark releases are 3.0.2 and 3.1.1 for now.

With Java 11, the suite runs with a hive metastore version which corresponds to the builtin Hive version and it's 2.3.8 for the current master.

But branch-3.0 and branch-3.1 doesn't accept 2.3.8, the suite with Java 11 fails.

Issue Links

• links to: [Github] Pull Request #32670 (sarutak)