Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3319

multifilewc from hadoop examples seems to be broken in 0.20.205.0

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.20.205.0
    • 1.0.0
    • examples

    Description

      /usr/lib/hadoop/bin/hadoop jar /usr/lib/hadoop/hadoop-examples-0.20.205.0.22.jar multifilewc  examples/text examples-output/multifilewc
      11/10/31 16:50:26 INFO mapred.FileInputFormat: Total input paths to process : 2
      11/10/31 16:50:26 INFO mapred.JobClient: Running job: job_201110311350_0220
      11/10/31 16:50:27 INFO mapred.JobClient:  map 0% reduce 0%
      11/10/31 16:50:42 INFO mapred.JobClient: Task Id : attempt_201110311350_0220_m_000000_0, Status : FAILED
      java.lang.ClassCastException: org.apache.hadoop.io.IntWritable cannot be cast to org.apache.hadoop.io.LongWritable
      	at org.apache.hadoop.mapred.lib.LongSumReducer.reduce(LongSumReducer.java:44)
      	at org.apache.hadoop.mapred.Task$OldCombinerRunner.combine(Task.java:1431)
      	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1436)
      	at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1298)
      	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:437)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
      	at org.apache.hadoop.mapred.Child$4.run(Child.java:255)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:396)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
      	at org.apache.hadoop.mapred.Child.main(Child.java:249)
      

      Attachments

        1. MAPREDUCE-3319.patch
          2 kB
          Subroto Sanyal

        Activity

          People

            subrotosanyal Subroto Sanyal
            rvs Roman Shaposhnik
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: