[HIVE-26445] Use tez.local.mode.without.network for qtests

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0
• Labels: pull-request-available
• Assignee: László Bodor
• Reporter: László Bodor
• Created: 02/Aug/22 14:24
• Updated: 29/Mar/24 17:49
• Resolved: 12/Feb/24 08:53

Description

looks like in case of iceberg, the local dagclient behaves weird:

2022-08-02T06:54:36,669 ERROR [2f953972-7675-4594-8d6b-d1c295c056a5 Time-limited test] tez.TezTask: Failed to execute tez graph.
java.lang.NullPointerException: null
	at org.apache.hadoop.hive.ql.exec.tez.TezTask.collectCommitInformation(TezTask.java:367) ~[hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:279) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:212) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:354) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:327) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:244) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:105) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:355) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:205) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:154) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]
	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:149) [hive-exec-4.0.0-alpha-2-SNAPSHOT.jar:4.0.0-alpha-2-SNAPSHOT]

it's thrown from https://github.com/apache/hive/blob/e0f2d287c562423dc2632910aae4f1cd8bcd4b4d/ql/src/java/org/apache/hadoop/hive/ql/exec/tez/TezTask.java#L367

Issue Links

• is blocked by: TEZ-4447 Collect VertexStatus properly when DAGClientServer is not used (local mode without network)
• is blocked by: HIVE-27992 Upgrade to tez 0.10.3
• is related to: HIVE-26444 Use tez.local.mode.without.network for unit tests
• links to: GitHub Pull Request #3583
• links to: GitHub Pull Request #5078