Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3004

sort example fails in shuffle/reduce stage as it assumes a local job by default

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • mrv2
    • None
    • mr2,mapreduce-2.0

    Description

      Log trace when running sort on a single node setup:

      11/09/13 17:01:06 INFO mapreduce.Job: map 100% reduce 0%
      11/09/13 17:01:10 INFO mapreduce.Job: Task Id : attempt_1315949787252_0009_r_000000_0, Status : FAILED
      java.lang.UnsupportedOperationException: Incompatible with LocalRunner
      at org.apache.hadoop.mapred.YarnOutputFiles.getInputFile(YarnOutputFiles.java:200)
      at org.apache.hadoop.mapred.ReduceTask.getMapFiles(ReduceTask.java:183)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:365)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)

      Attachments

        1. mapreduce-3004-branch-0.23.3.patch
          7 kB
          Hitesh Shah
        2. mapreduce-3004-branch-0.23.2.patch
          3 kB
          Hitesh Shah
        3. mapreduce-3004-branch-0.23.patch
          1 kB
          Hitesh Shah

        Activity

          People

            hitesh Hitesh Shah
            hitesh Hitesh Shah
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: