Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2129

Job may hang if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent>0

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.2, 0.20.3, 0.21.1
    • Fix Version/s: 1.1.0
    • Component/s: jobtracker
    • Labels:
    • Target Version/s:
    • Tags:
      setup/cleanup

      Description

      Job may hang at RUNNING state if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent>0. It happens when some tasks fail but havent reached failures.maxpercent.

      1. MAPREDUCE-2129.patch
        0.8 kB
        Kang Xiao
      2. MAPREDUCE-2129.patch
        1 kB
        Subroto Sanyal
      3. MAPREDUCE-2129.patch
        2 kB
        Ravi Prakash
      4. MAPREDUCE-2129.patch
        3 kB
        Thomas Graves

        Activity

        Kang Xiao created issue -
        Kang Xiao made changes -
        Field Original Value New Value
        Summary Job may hang if mapreduce.job.committer.setup.cleanup.needed=true and mapreduce.map/reduce.failures.maxpercent>0 Job may hang if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent>0
        Description Job may hang at RUNNING state if mapreduce.job.committer.setup.cleanup.needed=true and mapreduce.map/reduce.failures.maxpercent>0. It happens when some tasks fail but havent reached failures.maxpercent. Job may hang at RUNNING state if mapreduce.job.committer.setup.cleanup.needed=false and mapreduce.map/reduce.failures.maxpercent>0. It happens when some tasks fail but havent reached failures.maxpercent.
        Kang Xiao made changes -
        Attachment MAPREDUCE-2129.patch [ 12456966 ]
        Subroto Sanyal made changes -
        Attachment MAPREDUCE-2129.patch [ 12489826 ]
        Subroto Sanyal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Labels hadoop
        Arun C Murthy made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Subroto Sanyal made changes -
        Assignee Subroto Sanyal [ subrotosanyal ]
        Subroto Sanyal made changes -
        Target Version/s 1.1.0 [ 12317960 ]
        Subroto Sanyal made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ravi Prakash made changes -
        Attachment MAPREDUCE-2129.patch [ 12519970 ]
        Harsh J made changes -
        Affects Version/s 0.21.0 [ 12314045 ]
        Affects Version/s 0.20.1 [ 12314047 ]
        Affects Version/s 0.22.0 [ 12314184 ]
        Thomas Graves made changes -
        Attachment MAPREDUCE-2129.patch [ 12535250 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Target Version/s 1.1.0 [ 12317960 ] 1.1.0, 1.2.0 [ 12317960, 12321661 ]
        Fix Version/s 1.2.0 [ 12321661 ]
        Resolution Fixed [ 1 ]
        Matt Foley made changes -
        Fix Version/s 1.1.0 [ 12317960 ]
        Fix Version/s 1.2.0 [ 12321661 ]
        Target Version/s 1.1.0, 1.2.0 [ 12317960, 12321661 ] 1.1.0 [ 12317960 ]
        Matt Foley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Subroto Sanyal
            Reporter:
            Kang Xiao
          • Votes:
            1 Vote for this issue
            Watchers:
            12 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development