[HADOOP-15501] [Umbrella] Upgrade efforts to Hadoop 3.x

• Type: Task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Target Version/s: 3.5.0
• Assignee: Unassigned
• Reporter: Sunil G
• Created: 23/May/18 12:52
• Updated: 04/Jan/24 12:28

Description

This is an umbrella ticket to manage all similar efforts to close gaps for upgrade efforts to 3.x.

Issue Links

• is blocked by: HADOOP-15502 Rolling upgrade from HADOOP 2.x to 3.x breaks due to backward in-compatible change in MetricsPlugin interface
• is blocked by: HDFS-13596 NN restart fails after RollingUpgrade from 2.x to 3.x
• is blocked by: YARN-8068 Application Priority field causes NPE in app timeline publish when Hadoop 2.7 based clients to 2.8+
• is blocked by: YARN-8346 Upgrading to 3.1 kills running containers with error "Opportunistic container queue is full"
• is blocked by: YARN-8399 NodeManager is giving 403 GSS exception post upgrade to 3.1 in secure mode
• is related to: HADOOP-15059 3.0 deployment cannot work with old version MR tar ball which breaks rolling upgrade
• is related to: HDFS-11096 Support rolling upgrade between 2.x and 3.x
• is related to: YARN-6142 Support rolling upgrade between 2.x and 3.x

Sub-Tasks

• Test and validate Tez 0.8.4/5 jobs run with hadoop 3.x: Open