[IMPALA-12917] Several tests in TestEventProcessingError fail

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: Impala 4.4.0
• Component/s: Backend
• Labels: broken-build
• Epic Color: ghx-label-1
• Assignee: Venugopal Reddy K
• Reporter: Daniel Becker
• Created: 18/Mar/24 12:20
• Updated: 29/Apr/24 22:22
• Resolved: 26/Mar/24 07:08

Description

The failing tests are
TestEventProcessingError.test_event_processor_error_alter_partition
TestEventProcessingError.test_event_processor_error_alter_partitions
TestEventProcessingError.test_event_processor_error_commit_compaction_event
TestEventProcessingError.test_event_processor_error_commit_txn
TestEventProcessingError.test_event_processor_error_stress_test

Stacktrace:

E   Error: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask. java.lang.NullPointerException
E   	at org.apache.tez.client.TezClient.cleanStagingDir(TezClient.java:424)
E   	at org.apache.tez.client.TezClient.start(TezClient.java:413)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.startSessionAndContainers(TezSessionState.java:556)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.openInternal(TezSessionState.java:387)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:302)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolSession.open(TezSessionPoolSession.java:106)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezTask.ensureSessionHasResources(TezTask.java:468)
E   	at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:227)
E   	at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:213)
E   	at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:105)
E   	at org.apache.hadoop.hive.ql.Executor.launchTask(Executor.java:356)
E   	at org.apache.hadoop.hive.ql.Executor.launchTasks(Executor.java:329)
E   	at org.apache.hadoop.hive.ql.Executor.runTasks(Executor.java:246)
E   	at org.apache.hadoop.hive.ql.Executor.execute(Executor.java:107)
E   	at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:809)
E   	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:546)
E   	at org.apache.hadoop.hive.ql.Driver.run(Driver.java:540)
E   	at org.apache.hadoop.hive.ql.reexec.ReExecDriver.run(ReExecDriver.java:190)
E   	at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:235)
E   	at org.apache.hive.service.cli.operation.SQLOperation.access$700(SQLOperation.java:92)
E   	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:340)
E   	at java.security.AccessController.doPrivileged(Native Method)
E   	at javax.security.auth.Subject.doAs(Subject.java:422)
E   	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1899)
E   	at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:360)
E   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
E   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
E   	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
E   	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
E   	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
E   	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
E   	at java.lang.Thread.run(Thread.java:748) (state=08S01,code=1)

These tests were introduced by IMPALA-12832, VenuReddy could you take a look?

Issue Links

• is caused by: IMPALA-12832 EventProcessor shouldn't stop for failures in single-table event