[SPARK-26896] Add maven profiles for running tests with JDK 11

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 3.0.0
• Component/s: Build
• Assignee: Unassigned
• Reporter: Imran Rashid
• Created: 15/Feb/19 22:17
• Updated: 16/Aug/19 09:28
• Resolved: 24/Jun/19 22:33

Description

Running unit tests w/ JDK 11 trips over some issues w/ the new module system. These can be worked around with the new --add-opens etc. commands. I think we need to add a build profile for JDK 11 to add some extra args to the test runners.

In particular:

1) removal of jaxb from java itself (used in pmml export in mllib)

2) Some reflective access which results in failures, eg.

Unable to make field jdk.internal.ref.PhantomCleanable
jdk.internal.ref.PhantomCleanable.prev accessible: module java.base does
not "opens jdk.internal.ref" to unnamed module

3) Some reflective access which results in warnings (you can add --illegal-access=warn to see all of these).

All I'm proposing we do here is put in the required handling to make these problems go away, not necessarily do the "right" thing by no longer referencing these unexposed internals.

Issue Links

• links to: GitHub Pull Request #23804