Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-734

java.util.ConcurrentModificationException observed in unreserving slots for HiRam Jobs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: capacity-sched
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Ran jobs out which 3 were HiRAM, the job were not removed from scheduler queue even after they successfully completed
      hadoop queue -info queue -showJobs displays somwthing like -:
      job_200907080724_0031 2 1247059146868 username NORMAL 0 running map tasks using 0 map slots. 0 additional slots reserved. 0 running reduce tasks using 0 reduce slots. 60 additional slots reserved.
      job_200907080724_0030 2 1247059146972 username NORMAL 0 running map tasks using 0 map slots. 0 additional slots reserved. 0 running reduce tasks using 0 reduce slots. 60 additional slots reserved.

      But it does not block anything, but seems like zombie process of system
      Jobtracker log show java.util.ConcurrentModificationException

      1. MAPREDUCE-734-20.patch
        2 kB
        Hemanth Yamijala
      2. MAPREDUCE-734-ydist.patch
        2 kB
        Sreekanth Ramakrishnan
      3. MAPREDUCE-734-2.patch
        9 kB
        Sreekanth Ramakrishnan
      4. MAPREDUCE-734-1.patch
        8 kB
        Sreekanth Ramakrishnan
      5. MAPREDUCE-734_0_20090708_yhadoop20.patch
        1 kB
        Arun C Murthy
      6. MAPREDUCE-734_0_20090708.patch
        1 kB
        Arun C Murthy

        Activity

        Karam Singh created issue -
        Arun C Murthy made changes -
        Field Original Value New Value
        Assignee Arun C Murthy [ acmurthy ]
        Arun C Murthy made changes -
        Attachment MAPREDUCE-734_0_20090708.patch [ 12412903 ]
        Arun C Murthy made changes -
        Arun C Murthy made changes -
        Fix Version/s 0.21.0 [ 12314045 ]
        Affects Version/s 0.21.0 [ 12314045 ]
        Sreekanth Ramakrishnan made changes -
        Attachment MAPREDUCE-734-1.patch [ 12412971 ]
        Sreekanth Ramakrishnan made changes -
        Attachment MAPREDUCE-734-2.patch [ 12412976 ]
        Sreekanth Ramakrishnan made changes -
        Attachment MAPREDUCE-734-ydist.patch [ 12412996 ]
        Hemanth Yamijala made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Hemanth Yamijala made changes -
        Attachment MAPREDUCE-734-20.patch [ 12413035 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Arun C Murthy
            Reporter:
            Karam Singh
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development