[HIVE-23930] Upgrade to tez 0.10.0

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Labels: pull-request-available
• Assignee: László Bodor
• Reporter: László Bodor
• Created: 24/Jul/20 16:43
• Updated: 17/Nov/22 08:48
• Resolved: 28/Oct/20 21:14

Description

Tez 0.10.0 is not yet released, but this ticket is for tracking the effort and the needed hive changes.

Currently, Hive depends on 0.9.1

Hadoop dependencies:
Hive/master: 3.1.0
Tez/master: 3.1.3
Tez/branch-0.9: 2.7.2

TODOs:

• check why HIVE-23689 broke some unit tests intermittently (0.9.2 ->0.9.3 bump), because a 0.10.x upgrade will also contain those tez changes which could be related

• maintain the needed hive changes (reflecting tez api changes):
  HIVE-23190: LLAP: modify IndexCache to pass filesystem object to TezSpillRecord

Issue Links

• blocks: HIVE-22415 Upgrade to Java 11
• is blocked by: TEZ-4230 LocalContainerLauncher can kill task future too early, causing app hang
• is blocked by: HIVE-23190 LLAP: modify IndexCache to pass filesystem object to TezSpillRecord
• is blocked by: HIVE-24108 AddToClassPathAction should use TezClassLoader
• links to: GitHub Pull Request #1311