Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4375

Accesses to CompletedJobStore should not lock the JobTracker.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      When CompletedJobStatusStore is configured to use dfs, it can cause lockup of JT due to inline dfs access.
      For e.g.

        public synchronized JobStatus getJobStatus(JobID jobid) {
          JobInProgress job = jobs.get(jobid);
          if (job != null) {
            return job.getStatus();
          } else {
            return completedJobStatusStore.readJobStatus(jobid);
          }
        }
      

      Instead, JT should be locked only when accessing its internal memory structures. The other such methods are JobTracker.getJobCounters, JobTracker.getJobProfile and JobTracker.finalizeJob.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              vinodkv Vinod Kumar Vavilapalli
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: