[HIVE-26436] Hive on MR NullPointerException

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.2
• Component/s: Query Planning
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: TE
• Created: 28/Jul/22 14:14
• Updated: 20/Oct/22 00:29

Description

2022-07-27 11:23:26,337 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1658508427196_17228_m_000000_3: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators
    at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:211)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
    at org.apache.hadoop.hive.ql.exec.mr.ExecMapRunner.run(ExecMapRunner.java:37)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
Caused by: java.lang.NullPointerException
    at org.apache.hadoop.hive.ql.exec.Operator.getCounterName(Operator.java:502)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:742)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
    at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
    at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:193)
    ... 9 more

 

Hive on MR run failed and the error details is above.

Hive version: 3.1.2

 

When initializeOp has not been called and close called, this exception will happen.

Issue Links

• links to: GitHub Pull Request #3485