[FLINK-8033] JDK 9 support

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.4.0
• Fix Version/s: 1.9.0
• Component/s: Build System
• Labels: pull-request-available

Release Note

Flink can be compiled and run on Java 9. Note that certain components interacting with external systems (connectors, filesystems, reporters) may not work since the respective projects may have skipped Java 9 support.
Modularized user-jars have not been tested and may or may not work.

• Assignee: Chesnay Schepler
• Reporter: Hai Zhou
• Created: 08/Nov/17 14:46
• Updated: 02/Oct/19 17:49
• Resolved: 11/Jul/19 09:34

Description

This is a JIRA to track all issues that found to make Flink compatible with Java 9.

Issue Links

• is blocked by: FLINK-7811 Add support for Scala 2.12
• is blocked by: HADOOP-11123 Fix Java 9 incompatibilies in Hadoop
• is depended upon by: FLINK-10725 Support for Java 11 (LTS)
• is duplicated by: FLINK-8153 Upgrade to JDK 9
• is related to: FLINK-7777 Bump japicmp to 0.11.0
• is related to: FLINK-8320 Flink cluster does not work on Java 9
• relates to: FLINK-5339 Ensure Flink works with Log4j version 2
• relates to: FLINK-2485 Handle removal of Java Unsafe
• supercedes: FLINK-2485 Handle removal of Java Unsafe
• links to: GitHub Pull Request #48

Sub-Tasks

• Upgrade maven enforcer plugin to 3.0.0-M1: Closed
• Japicmp fails on java 9: Closed
• scala-maven-plugin fails on java 9: Closed
• Bump checkstyle-plugin to 8.9: Closed
• Bump mockito to 2.0+: Closed
• Exclude jdk.tools dependency from hadoop when running with java 9: Closed
• Remove usage of javax.xml.bind.DatatypeConverter: Resolved
• Lambda usage in FutureUtils is ambigouos with Java 9: Closed
• KafkaTableSourceSinkFactoryBase#getFlinkKafkaPartitioner does not compile with Java 9: Closed
• Bump shade-plugin to 3.1.1: Closed
• Bump asm version to 6: Closed
• SafetyNetCloseableRegistryTest fails with ClassCastException: Closed
• Make Tests runnable on Java 9: Closed
• ClosureCleanerTest fails with IllegalStateException: Closed
• Remove UdfAnalyzer: Closed
• HadoopFreeFsFactoryTest fails with ClassCastException: Closed
• ZooKeeperCompletedCheckpointStoreMockitoTest fails with IncompatibleClassChangeError: Closed
• JarFileCreatorTest fails when run with Java 9: Closed
• Set up nightly tests with Java 9: Closed
• Reporter filtering using "metrics.reporters" broken on Java 9+: Closed
• Upgrade Akka to 2.5: Closed
• GenericTypeInfoTest fails on Java 9: Closed
• ClassLoaderUtilsTest fails on Java 9: Closed
• HBaseConnectorITCase fails on Java 9: Closed
• E2E tests fail due to illegal-access warning on Java 9: Closed
• Elasticsearch(1)SinkITCase fails on Java 9: Closed
• Kafka 0.10/0.11 tests fail on Java 9: Closed
• FlinkILoopTest fails on Java 9: Closed
• CassandraConnectorITCase fails on Java 9: Closed
• BlockingShutdownTest fails on Java 9: Closed
• EnumValueSerializerUpgradeTest fails on Java 9: Closed
• Kafka 0.10/0.11 e2e test fails on Java 9: Closed
• JDBCFullTest fails on Java 9: Closed
• BlockingCallMonitoringThreadPool fails on Java 9: Closed
• TimestampITCase deadlocks on Java 9: Closed
• Deduplicate empty .out log file checks: Closed
• Kinesis e2e test fails on Java 9: Closed
• MetricsAvailabilityITCase fails on Java 9: Closed
• Containerized e2e tests fail on Java 9: Closed
• jdk.tools exclusion interfering with swift-fs-hadoop build: Closed
• Setup Java 9 cron jobs: Closed