Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Invalid
-
None
-
None
-
None
Description
Sometimes, The wordcountmrr job with tez framwork enabled and using tez-mapreduce-examples.jar fails with "Negative key-length: -17" error.
Snapshot of application master log.
2013-06-20 20:56:07,638 INFO [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.TaskAttemptImpl: attempt_1371757993531_10_1_000001_000000_3 TaskAttempt Transitioned from RUNNING to FAIL_IN_PROGRESS
2013-06-20 20:56:07,639 INFO [AsyncDispatcher event handler] org.apache.tez.dag.history.HistoryEventHandler: [HISTORY][DAG:dag_1371757993531_10_000001][Event:TASK_ATTEMPT_FINISHED]: vertexName=ivertex1, taskAttemptId=attempt_1371757993531_10_1_000001_000000_3, finishTime=1371761767638, status=FAILED, diagnostics=Error: java.io.IOException: Rec# 7494138: Negative key-length: -17
at org.apache.tez.engine.common.sort.impl.IFile$Reader.positionToNextRecord(IFile.java:476)
at org.apache.tez.engine.common.sort.impl.IFile$Reader.readRawKey(IFile.java:492)
at org.apache.tez.engine.common.sort.impl.IFile$Reader.nextRawKey(IFile.java:488)
at org.apache.tez.engine.common.sort.impl.TezMerger$Segment.nextRawKey(TezMerger.java:308)
at org.apache.tez.engine.common.sort.impl.TezMerger$MergeQueue.adjustPriorityQueue(TezMerger.java:462)
at org.apache.tez.engine.common.sort.impl.TezMerger$MergeQueue.next(TezMerger.java:482)
at org.apache.tez.mapreduce.processor.reduce.ReduceProcessor$2.next(ReduceProcessor.java:291)
at org.apache.tez.mapreduce.processor.MRTask$1.next(MRTask.java:637)
at org.apache.hadoop.mapreduce.task.ReduceContextImpl.nextKeyValue(ReduceContextImpl.java:154)
at org.apache.hadoop.mapreduce.task.ReduceContextImpl.nextKey(ReduceContextImpl.java:121)
at org.apache.hadoop.mapreduce.lib.reduce.WrappedReducer$Context.nextKey(WrappedReducer.java:297)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:170)
at org.apache.tez.mapreduce.processor.reduce.ReduceProcessor.runNewReducer(ReduceProcessor.java:331)
at org.apache.tez.mapreduce.processor.reduce.ReduceProcessor.process(ReduceProcessor.java:150)
at org.apache.tez.engine.task.RuntimeTask.run(RuntimeTask.java:79)
at org.apache.tez.mapreduce.task.MRRuntimeTask.run(MRRuntimeTask.java:144)
at org.apache.hadoop.mapred.YarnTezDagChild.runTezTask(YarnTezDagChild.java:334)
at org.apache.hadoop.mapred.YarnTezDagChild.access$000(YarnTezDagChild.java:76)
at org.apache.hadoop.mapred.YarnTezDagChild$2.run(YarnTezDagChild.java:178)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1477)
at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:175)