Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2535

JobClient creates a RunningJob with null status and profile

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.20.204.0
    • None
    • client
    • None
    • Reviewed

    Description

      Exception occurred because the job was retired and is removed from RetireJobCcahe and CompletedJobStatusStore. But, the
      JobClient creates a RunningJob with null status and profile, if getJob(JobID) is called again.
      So, Even-though not null check is there in the following user code, it did not help.
      466 runningJob = jobClient.getJob(mapRedJobID);
      467 if(runningJob != null) {

      JobClient.getJob() should return null if status is null.

      In trunk this is fixed by validating that the job status is not null every time it is updated, and also verifying that that the profile data is not null when created.

      Attachments

        1. MR-2535-0.20.20X-V1.patch
          6 kB
          Robert Joseph Evans
        2. MR-2535-failures-v1.patch
          10 kB
          Robert Joseph Evans

        Activity

          People

            revans2 Robert Joseph Evans
            revans2 Robert Joseph Evans
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: