[SPARK-28703] Skip HiveExternalCatalogVersionsSuite and 3 tests in HiveSparkSubmitSuite at JDK9+

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 13/Aug/19 02:12
• Updated: 13/Aug/19 05:02
• Resolved: 13/Aug/19 03:42

Description

Skip more test when testing with JAVA_9 or later:

1. Skip test HiveExternalCatalogVersionsSuite when testing with JAVA_9 or later because our previous version does not support JAVA_9 or later.

1. Skip 3 tests in HiveSparkSubmitSuite because the spark.sql.hive.metastore.version of these tests is lower than 2.0, however Datanucleus 3.x seem does not support JAVA_9 or later. Hive upgrade Datanucleus to 4.x from Hive 2.0(HIVE-6113):

[info]   Cause: org.datanucleus.exceptions.NucleusException: The java type java.lang.Long (jdbc-type="", sql-type="") cant be mapped for this datastore. No mapping is available.
[info]   at org.datanucleus.store.rdbms.mapping.RDBMSMappingManager.getDatastoreMappingClass(RDBMSMappingManager.java:1215)
[info]   at org.datanucleus.store.rdbms.mapping.RDBMSMappingManager.createDatastoreMapping(RDBMSMappingManager.java:1378)
[info]   at org.datanucleus.store.rdbms.table.AbstractClassTable.addDatastoreId(AbstractClassTable.java:392)
[info]   at org.datanucleus.store.rdbms.table.ClassTable.initializePK(ClassTable.java:1087)
[info]   at org.datanucleus.store.rdbms.table.ClassTable.preInitialize(ClassTable.java:247)

Issue Links

• causes: SPARK-28704 Test backward compatibility on JDK9+ once we have a version supports JDK9+
• links to: GitHub Pull Request #25426