Issue Details (XML | Word | Printable)

Key: MAPREDUCE-63
Type: Bug Bug
Status: Open Open
Priority: Major Major
Assignee: Arun C Murthy
Reporter: Konstantin Shvachko
Votes: 1
Watchers: 2
Operations

If you were logged in you would be able to see more operations.
Hadoop Map/Reduce

TaskTracker falls into an infinite loop.

Created: 16/May/07 02:59 AM   Updated: 20/Jun/09 07:50 AM
Return to search
Component/s: None
Affects Version/s: None
Fix Version/s: None

Time Tracking:
Not Specified

File Attachments:
  Size
Text File DataNode1.log 2007-05-25 02:03 AM Konstantin Shvachko 6 kB
Text File DataNode2.log 2007-05-25 02:03 AM Konstantin Shvachko 7 kB
GZip Archive hadoop-1374-yunhong.tar.gz 2008-01-25 12:43 AM Yunhong Gu 4 kB
Text File JobTracker.log 2007-05-25 02:02 AM Konstantin Shvachko 11 kB
Text File NameNode.log 2007-05-25 02:03 AM Konstantin Shvachko 4 kB
Text File TaskTracker1.log 2007-05-25 02:02 AM Konstantin Shvachko 14 kB
Text File TaskTracker2.log 2007-05-25 02:02 AM Konstantin Shvachko 9 kB
Text File TestDFSIO.log 2007-05-25 02:11 AM 0.9 kB
Issue Links:
Duplicate
 


 Description  « Hide
All maps had been completed successfully. I had only one reduce task during which
TaskTracker infinitely outputs:

07/05/15 19:35:41 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:42 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:43 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:44 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >
07/05/15 19:35:45 INFO mapred.TaskTracker: task_0001_r_000000_0 0.16666667% reduce > copy (4 of 8 at 0.00 MB/s) >

JobTracker does not log anything about task task_0001_r_000000_0 except for
07/05/15 19:49:01 INFO mapred.JobTracker: Adding task 'task_0001_r_000000_0' to tip tip_0001_r_000000, for tracker 'tracker_my-host.com:50050'



 All   Comments   Work Log   Change History   Subversion Commits      Sort Order: Ascending order - Click to sort in descending order
Owen O'Malley made changes - 21/May/07 11:33 PM
Field Original Value New Value
Fix Version/s 0.13.0 [ 12312348 ]
Fix Version/s 0.14.0 [ 12312474 ]
Owen O'Malley made changes - 23/May/07 12:11 AM
Assignee Arun C Murthy [ acmurthy ]
Fix Version/s 0.13.0 [ 12312348 ]
Fix Version/s 0.14.0 [ 12312474 ]
Component/s mapred [ 12310690 ]
Arun C Murthy made changes - 23/May/07 03:24 AM
Comment [ Owen, I'm not sure these are related... the code in question:

<pre class="code-java">
else if ("-events".equals(argv[i])) {
        listEvents(argv[i+1], Integer.parseInt(argv[i+2]),
                   Integer.parseInt(argv[i+3]));
        i += 3;
      }</pre>

So incomplete args to
<pre class="code-java">
$ bin/hadoop job -events job_0001<fromeventid> <numEvents> </pre>
could be the reason for the ArrayIndexOutOfBoundsException you noticed? *smile* ]
Arun C Murthy made changes - 23/May/07 09:11 AM
Fix Version/s 0.14.0 [ 12312474 ]
Fix Version/s 0.13.0 [ 12312348 ]
Konstantin Shvachko made changes - 25/May/07 02:02 AM
Attachment JobTracker.log [ 12358181 ]
Attachment TaskTracker1.log [ 12358179 ]
Attachment TaskTracker2.log [ 12358180 ]
Konstantin Shvachko made changes - 25/May/07 02:03 AM
Attachment NameNode.log [ 12358184 ]
Attachment DataNode2.log [ 12358183 ]
Attachment DataNode1.log [ 12358182 ]
Konstantin Shvachko made changes - 25/May/07 02:16 AM
Fix Version/s 0.13.0 [ 12312348 ]
Priority Major [ 3 ] Blocker [ 1 ]
Fix Version/s 0.14.0 [ 12312474 ]
Owen O'Malley made changes - 29/May/07 06:25 PM
Priority Blocker [ 1 ] Major [ 3 ]
Fix Version/s 0.13.0 [ 12312348 ]
Fix Version/s 0.14.0 [ 12312474 ]
Marco Nicosia made changes - 18/Jun/07 10:57 PM
Priority Major [ 3 ] Blocker [ 1 ]
Owen O'Malley made changes - 13/Jul/07 04:46 AM
Priority Blocker [ 1 ] Major [ 3 ]
Fix Version/s 0.15.0 [ 12312565 ]
Fix Version/s 0.14.0 [ 12312474 ]
Owen O'Malley made changes - 12/Sep/07 05:56 AM
Link This issue duplicates HADOOP-1862 [ HADOOP-1862 ]
Doug Cutting made changes - 10/Oct/07 09:56 PM
Fix Version/s 0.15.0 [ 12312565 ]
Yunhong Gu made changes - 25/Jan/08 12:43 AM
Attachment hadoop-1374-yunhong.tar.gz [ 12373994 ]
Owen O'Malley made changes - 20/Jun/09 07:50 AM
Component/s mapred [ 12310690 ]
Affects Version/s 0.12.3 [ 12312403 ]
Key HADOOP-1374 MAPREDUCE-63
Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]