[ORC-1248] Redefine Hadoop dependency for Apache ORC 1.8.0

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.8.0
• Fix Version/s: 1.8.0
• Component/s: Java
• Labels: releasenotes
• Assignee: William Hyun
• Reporter: William Hyun
• Created: 10/Aug/22 19:32
• Updated: 03/Sep/22 22:43
• Resolved: 10/Aug/22 19:41

Description

This issue is an umbrella JIRA to increase the minimum Hadoop version to 2.7.3 for Apache ORC 1.8.0 which is going to be released on September 2022 and will be supported for three years until September 2025.

Apache Hadoop 2.2 ~ 2.6 are too old to support until 2025.

• Apache Hadoop 2.2.0 was released on Oct, 2013.
• Apache Hadoop 2.3.0 was released on Feb, 2014.
• Apache Hadoop 2.4.0 was released on Mar, 2014.
• Apache Hadoop 2.5.0 was released on Aug, 2014.
• Apache Hadoop 2.6.0 was released on Nov, 2014.
• Apache Hadoop 2.7.0 was released on Apr, 2015.

Issue Links

• relates to: ORC-883 Dependency Audit and QA

Sub-Tasks

• Set min.hadoop.version to 2.7.3: Closed
• Upgrade tools.hadoop.version to 2.10.2: Closed
• Use Hadoop 3.3.4 on Java 17+ and benchmark: Closed
• Use hadoop 3.3.3 on Java 17+: Closed
• Use Hadoop 3.3.2 on Java 17+: Closed
• Add a deprecation warning for Hadoop 2.7.2 and below: Closed
• Move encryption utility functions to HadoopShimsCurrent: Closed
• Move KeyProviderImpl to org.apache.orc.impl: Closed
• Move getDecompressor to HadoopShimsCurrent: Closed
• Move DirectDecompressWrapper to org.apache.orc.impl: Closed
• Move NullKeyProvider to org.apache.orc.impl: Closed