Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3004

sort example fails in shuffle/reduce stage as it assumes a local job by default

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: mrv2
    • Labels:
      None
    • Tags:
      mr2,mapreduce-2.0

      Description

      Log trace when running sort on a single node setup:

      11/09/13 17:01:06 INFO mapreduce.Job: map 100% reduce 0%
      11/09/13 17:01:10 INFO mapreduce.Job: Task Id : attempt_1315949787252_0009_r_000000_0, Status : FAILED
      java.lang.UnsupportedOperationException: Incompatible with LocalRunner
      at org.apache.hadoop.mapred.YarnOutputFiles.getInputFile(YarnOutputFiles.java:200)
      at org.apache.hadoop.mapred.ReduceTask.getMapFiles(ReduceTask.java:183)
      at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:365)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:148)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:143)

      1. mapreduce-3004-branch-0.23.2.patch
        3 kB
        Hitesh Shah
      2. mapreduce-3004-branch-0.23.3.patch
        7 kB
        Hitesh Shah
      3. mapreduce-3004-branch-0.23.patch
        1 kB
        Hitesh Shah

        Activity

          People

          • Assignee:
            Hitesh Shah
            Reporter:
            Hitesh Shah
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development