Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-683

TestJobTrackerRestart fails with Map task completion events ordering mismatch

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: jobtracker
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      TestJobTrackerRestart failed because of stale filemanager cache (which was created once per jvm). This patch makes sure that the filemanager is inited upon every JobHistory.init() and hence upon every restart. Note that this wont happen in production as upon a restart the new jobtracker will start in a new jvm and hence a new cache will be created.
      Show
      TestJobTrackerRestart failed because of stale filemanager cache (which was created once per jvm). This patch makes sure that the filemanager is inited upon every JobHistory.init() and hence upon every restart. Note that this wont happen in production as upon a restart the new jobtracker will start in a new jvm and hence a new cache will be created.
    • Tags:
      ygridqa

      Description

      TestJobTrackerRestart fails consistently with Map task completion events ordering mismatch error.

      1. MAPREDUCE-683-v1.2.1-branch-0.20.patch
        2 kB
        Amar Kamat
      2. MAPREDUCE-683-v1.2-branch-0.20.patch
        2 kB
        Amar Kamat
      3. MAPREDUCE-683-v1.2.patch
        2 kB
        Amar Kamat
      4. MAPREDUCE-683-v1.0.patch
        0.8 kB
        Amar Kamat
      5. TEST-org.apache.hadoop.mapred.TestJobTrackerRestart.txt
        255 kB
        Sreekanth Ramakrishnan

        Issue Links

          Activity

          Sreekanth Ramakrishnan created issue -
          Sreekanth Ramakrishnan made changes -
          Field Original Value New Value
          Attachment TEST-org.apache.hadoop.mapred.TestJobTrackerRestart.txt [ 12412152 ]
          Amar Kamat made changes -
          Assignee Amar Kamat [ amar_kamat ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-683-v1.0.patch [ 12412196 ]
          Amar Kamat made changes -
          Link This issue blocks MAPREDUCE-237 [ MAPREDUCE-237 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-683-v1.2.patch [ 12412256 ]
          Nigel Daley made changes -
          Tags ygridqa
          Devaraj Das made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Devaraj Das made changes -
          Fix Version/s 0.21.0 [ 12314045 ]
          Affects Version/s 0.21.0 [ 12314045 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-683-v1.2-branch-0.20.patch [ 12412742 ]
          Amar Kamat made changes -
          Attachment MAPREDUCE-683-v1.2.1-branch-0.20.patch [ 12412743 ]
          Amar Kamat made changes -
          Release Note TestJobTrackerRestart failed because of stale filemanager cache (which was created once per jvm). This patch makes sure that the filemanager is inited upon every JobHistory.init() and hence upon every restart. Note that this wont happen in production as upon a restart the new jobtracker will start in a new jvm and hence a new cache will be created.
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Gavin made changes -
          Link This issue blocks MAPREDUCE-237 [ MAPREDUCE-237 ]
          Gavin made changes -
          Link This issue is depended upon by MAPREDUCE-237 [ MAPREDUCE-237 ]

            People

            • Assignee:
              Amar Kamat
              Reporter:
              Sreekanth Ramakrishnan
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development