Total jobs = 1 16/03/10 16:11:24 WARN conf.Configuration: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10007/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval; Ignoring. 16/03/10 16:11:24 WARN conf.Configuration: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10007/jobconf.xml:an attempt to override final parameter: io.file.buffer.size; Ignoring. 16/03/10 16:11:24 WARN conf.Configuration: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10007/jobconf.xml:an attempt to override final parameter: hadoop.tmp.dir; Ignoring. 16/03/10 16:11:24 WARN conf.Configuration: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10007/jobconf.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts; Ignoring. Execution log at: /tmp/bigdata/bigdata_20160310161111_7d83503a-8e8e-445a-9b9a-05d53f61c3c1.log 2016-03-10 04:11:25 Starting to launch local task to process map join; maximum memory = 515375104 2016-03-10 04:11:26 Dump the side-table into file: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile00--.hashtable 2016-03-10 04:11:26 Uploaded 1 File to: file:/tmp/bigdata/hive_2016-03-10_16-11-18_022_8377763122361446197-1/-local-10004/HashTable-Stage-2/MapJoin-mapfile00--.hashtable (750 bytes) 2016-03-10 04:11:26 End of local task; Time Taken: 1.023 sec. Execution completed successfully MapredLocal task succeeded Launching Job 1 out of 1 Number of reduce tasks not specified. Estimated from input data size: 1 In order to change the average load for a reducer (in bytes): set hive.exec.reducers.bytes.per.reducer= In order to limit the maximum number of reducers: set hive.exec.reducers.max= In order to set a constant number of reducers: set mapreduce.job.reduces= Starting Job = job_1457504656024_0021, Tracking URL = http://namenode2:8088/proxy/application_1457504656024_0021/ Kill Command = /home/bigdata/software/hadoop/bin/hadoop job -kill job_1457504656024_0021 Hadoop job information for Stage-2: number of mappers: 1; number of reducers: 1 2016-03-10 16:11:37,523 Stage-2 map = 0%, reduce = 0% 2016-03-10 16:11:48,167 Stage-2 map = 100%, reduce = 0%, Cumulative CPU 4.12 sec 2016-03-10 16:12:20,930 Stage-2 map = 100%, reduce = 100%, Cumulative CPU 4.12 sec MapReduce Total cumulative CPU time: 4 seconds 120 msec Ended Job = job_1457504656024_0021 with errors Error during job, obtaining debugging information... Examining task ID: task_1457504656024_0021_m_000000 (and more) from job job_1457504656024_0021 Task with the most failures(4): ----- Task ID: task_1457504656024_0021_r_000000 URL: http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1457504656024_0021&tipid=task_1457504656024_0021_r_000000 ----- Diagnostic Messages for this Task: Error: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error: Unable to deserialize reduce input key from x1x50x52x48x48x48x0x1x0x1x1x255 with properties {columns=_col0,_col1, serialization.lib=org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe, serialization.sort.order=++, columns.types=string,uniontype>} at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:283) at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:444) at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162) Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error: Unable to deserialize reduce input key from x1x50x52x48x48x48x0x1x0x1x1x255 with properties {columns=_col0,_col1, serialization.lib=org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe, serialization.sort.order=++, columns.types=string,uniontype>} at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:222) ... 7 more Caused by: org.apache.hadoop.hive.serde2.SerDeException: java.io.EOFException at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:189) at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.reduce(ExecReducer.java:220) ... 7 more Caused by: java.io.EOFException at org.apache.hadoop.hive.serde2.binarysortable.InputByteBuffer.read(InputByteBuffer.java:54) at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserializeText(BinarySortableSerDe.java:550) at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:285) at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:509) at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:522) at org.apache.hadoop.hive.serde2.binarysortable.BinarySortableSerDe.deserialize(BinarySortableSerDe.java:185) ... 8 more FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask MapReduce Jobs Launched: Job 0: Map: 1 Reduce: 1 Cumulative CPU: 4.12 sec HDFS Read: 26670632 HDFS Write: 0 FAIL Total MapReduce CPU Time Spent: 4 seconds 120 msec