[#MAPREDUCE-63] TaskTracker falls into an infinite loop.

Hadoop Map/Reduce

TaskTracker falls into an infinite loop.

Created: 16/May/07 02:59 AM Updated: 20/Jun/09 07:50 AM

Return to search

Component/s:

None

Affects Version/s:

None

Fix Version/s:

None

Time Tracking:

Not Specified

File Attachments:

File Name	Date Attached	Attached By	Size
DataNode1.log	2007-05-25 02:03 AM	Konstantin Shvachko	6 kB
DataNode2.log	2007-05-25 02:03 AM	Konstantin Shvachko	7 kB
hadoop-1374-yunhong.tar.gz	2008-01-25 12:43 AM	Yunhong Gu	4 kB
JobTracker.log	2007-05-25 02:02 AM	Konstantin Shvachko	11 kB
NameNode.log	2007-05-25 02:03 AM	Konstantin Shvachko	4 kB
TaskTracker1.log	2007-05-25 02:02 AM	Konstantin Shvachko	14 kB
TaskTracker2.log	2007-05-25 02:02 AM	Konstantin Shvachko	9 kB
TestDFSIO.log	2007-05-25 02:11 AM		0.9 kB

Issue Links:

Duplicate

This issue duplicates:

~~HADOOP-1862~~ reduces are getting stuck trying to find map outputs

Description

« Hide

All maps had been completed successfully. I had only one reduce task during which
TaskTracker infinitely outputs:

07/05/15 19:35:41 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:42 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:43 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:44 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:45 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >

JobTracker does not log anything about task task_0001_r_000000_0 except for
07/05/15 19:49:01 INFO mapred.JobTracker: Adding task 'task_0001_r_000000_0' to tip tip_0001_r_000000, for tracker 'tracker_my-host.com:50050'

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Owen O'Malley made changes - 21/May/07 11:33 PM

Field	Original Value	New Value
Fix Version/s	0.13.0 [ 12312348 ]
Fix Version/s		0.14.0 [ 12312474 ]

Owen O'Malley made changes - 23/May/07 12:11 AM

Assignee		Arun C Murthy [ acmurthy ]
Fix Version/s		0.13.0 [ 12312348 ]
Fix Version/s	0.14.0 [ 12312474 ]
Component/s		mapred [ 12310690 ]

Arun C Murthy made changes - 23/May/07 03:24 AM

Comment

[ Owen, I'm not sure these are related... the code in question:

<pre class="code-java">
else if ("-events".equals(argv[i])) {
        listEvents(argv[i+1], Integer.parseInt(argv[i+2]),
                   Integer.parseInt(argv[i+3]));
        i += 3;
      }</pre>

So incomplete args to
<pre class="code-java">
$ bin/hadoop job -events job_0001<fromeventid> <numEvents> </pre>
could be the reason for the ArrayIndexOutOfBoundsException you noticed? *smile* ]

Arun C Murthy made changes - 23/May/07 09:11 AM

Fix Version/s		0.14.0 [ 12312474 ]
Fix Version/s	0.13.0 [ 12312348 ]

Konstantin Shvachko made changes - 25/May/07 02:02 AM

Attachment		JobTracker.log [ 12358181 ]
Attachment		TaskTracker1.log [ 12358179 ]
Attachment		TaskTracker2.log [ 12358180 ]

Konstantin Shvachko made changes - 25/May/07 02:03 AM

Attachment		NameNode.log [ 12358184 ]
Attachment		DataNode2.log [ 12358183 ]
Attachment		DataNode1.log [ 12358182 ]

Anonymous made changes - 25/May/07 02:11 AM

Attachment

TestDFSIO.log [ 12358185 ]

Konstantin Shvachko made changes - 25/May/07 02:16 AM

Fix Version/s		0.13.0 [ 12312348 ]
Priority	Major [ 3 ]	Blocker [ 1 ]
Fix Version/s	0.14.0 [ 12312474 ]

Owen O'Malley made changes - 29/May/07 06:25 PM

Priority	Blocker [ 1 ]	Major [ 3 ]
Fix Version/s	0.13.0 [ 12312348 ]
Fix Version/s		0.14.0 [ 12312474 ]

Marco Nicosia made changes - 18/Jun/07 10:57 PM

Priority

Major [ 3 ]

Blocker [ 1 ]

Owen O'Malley made changes - 13/Jul/07 04:46 AM

Priority	Blocker [ 1 ]	Major [ 3 ]
Fix Version/s		0.15.0 [ 12312565 ]
Fix Version/s	0.14.0 [ 12312474 ]

Owen O'Malley made changes - 12/Sep/07 05:56 AM

Link

This issue duplicates ~~HADOOP-1862~~ [ ~~HADOOP-1862~~ ]

Doug Cutting made changes - 10/Oct/07 09:56 PM

Fix Version/s

0.15.0 [ 12312565 ]

Yunhong Gu made changes - 25/Jan/08 12:43 AM

Attachment

hadoop-1374-yunhong.tar.gz [ 12373994 ]

Owen O'Malley made changes - 20/Jun/09 07:50 AM

Component/s	mapred [ 12310690 ]
Affects Version/s	0.12.3 [ 12312403 ]
Key	HADOOP-1374	MAPREDUCE-63
Project	Hadoop Common [ 12310240 ]	Hadoop Map/Reduce [ 12310941 ]