[HIVE-15089] Error: java.lang.RuntimeException: Hive Runtime Error while closing operators: java.lang.Integer cannot be cast to java.lang.Boolean

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed

Release Note

Warning: Shuffle Join JOIN[4][tables = [a, b]] in Stage 'Stage-1:MAPRED' is a cross product
Query ID = ubuntu_20161028024059_c1f407e0-47e1-4a44-8da2-968b55e6f2fd
Total jobs = 3
Stage-1 is selected by condition resolver.
Launching Job 1 out of 3
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapreduce.job.reduces=<number>
Starting Job = job_1477557082231_0016, Tracking URL = http://master:8088/proxy/application_1477557082231_0016/
Kill Command = /home/ubuntu/cloud/hadoop-2.7.2/bin/hadoop job -kill job_1477557082231_0016
Hadoop job information for Stage-1: number of mappers: 2; number of reducers: 1
2016-10-28 02:41:07,953 Stage-1 map = 0%, reduce = 0%
2016-10-28 02:41:15,256 Stage-1 map = 50%, reduce = 0%, Cumulative CPU 1.52 sec
2016-10-28 02:41:23,573 Stage-1 map = 90%, reduce = 0%, Cumulative CPU 10.95 sec
2016-10-28 02:41:24,606 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 12.18 sec
2016-10-28 02:41:29,766 Stage-1 map = 100%, reduce = 85%, Cumulative CPU 19.38 sec
2016-10-28 02:41:32,878 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 21.93 sec
2016-10-28 02:41:38,026 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 12.18 sec
2016-10-28 02:41:48,349 Stage-1 map = 100%, reduce = 85%, Cumulative CPU 20.76 sec
2016-10-28 02:41:51,438 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 23.95 sec
2016-10-28 02:41:54,518 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 26.97 sec
2016-10-28 02:41:57,604 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 12.18 sec
2016-10-28 02:42:07,871 Stage-1 map = 100%, reduce = 84%, Cumulative CPU 20.84 sec
2016-10-28 02:42:10,959 Stage-1 map = 100%, reduce = 99%, Cumulative CPU 23.98 sec
2016-10-28 02:42:14,034 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 27.32 sec
2016-10-28 02:42:17,104 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 12.18 sec
2016-10-28 02:42:27,380 Stage-1 map = 100%, reduce = 87%, Cumulative CPU 19.79 sec
2016-10-28 02:42:30,474 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 22.61 sec
MapReduce Total cumulative CPU time: 22 seconds 610 msec
Ended Job = job_1477557082231_0016 with errors
Error during job, obtaining debugging information...
Examining task ID: task_1477557082231_0016_m_000001 (and more) from job job_1477557082231_0016

Task with the most failures(4):
-----
Task ID:
  task_1477557082231_0016_r_000000

URL:
  http://master:8088/taskdetails.jsp?jobid=job_1477557082231_0016&tipid=task_1477557082231_0016_r_000000
-----
Diagnostic Messages for this Task:
Error: java.lang.RuntimeException: Hive Runtime Error while closing operators: java.lang.Integer cannot be cast to java.lang.Boolean
        at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.close(ExecReducer.java:286)
        at org.apache.hadoop.io.IOUtils.cleanup(IOUtils.java:244)
        at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:459)
        at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.lang.ClassCastException: java.lang.Integer cannot be cast to java.lang.Boolean
        at org.apache.hadoop.hive.ql.exec.FilterOperator.process(FilterOperator.java:119)
        at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:837)
        at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.internalForward(CommonJoinOperator.java:644)
        at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genUniqueJoinObject(CommonJoinOperator.java:657)
        at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.genUniqueJoinObject(CommonJoinOperator.java:660)
        at org.apache.hadoop.hive.ql.exec.CommonJoinOperator.checkAndGenObject(CommonJoinOperator.java:756)
        at org.apache.hadoop.hive.ql.exec.JoinOperator.endGroup(JoinOperator.java:256)
        at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.close(ExecReducer.java:275)
        ... 8 more


FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
MapReduce Jobs Launched:
Stage-Stage-1: Map: 2 Reduce: 1 Cumulative CPU: 22.61 sec HDFS Read: 41921254 HDFS Write: 0 FAIL
Total MapReduce CPU Time Spent: 22 seconds 610 msec

• Assignee: Unassigned
• Reporter: chen cong
• Created: 28/Oct/16 03:02
• Updated: 26/Aug/19 13:02
• Resolved: 28/Oct/16 07:57

Description

SELECT userid , gamename , SUM(times) AS sumtimes
FROM user_fenci_sumcount A
RIGHT JOIN need_recommende_game B
ON (TRUE)
WHERE LOCATE(A.fenci,B.gamename)
GROUP BY userid , gamename
ORDER BY A.userid , sumtimes DESC

Error: java.lang.RuntimeException: Hive Runtime Error while closing operators: java.lang.Integer cannot be cast to java.lang.Boolean

How can I solve it ?

Issue Links

• is related to: HIVE-15408 Support auto-casting non-boolean where condition into boolean
• relates to: HIVE-1478 Non-boolean expression in WHERE should be rejected