Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5335

Rename Job Tracker terminology in ShuffleSchedulerImpl

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.7.0
    • applicationmaster
    • None
    • Reviewed

    Description

      2013-06-17 17:27:30,134 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleScheduler: Reporting fetch failure for attempt_1371467533091_0005_m_000010_0 to jobtracker.
      
      ShuffleSchedulerImpl.java
        // Notify the JobTracker
        // after every read error, if 'reportReadErrorImmediately' is true or
        // after every 'maxFetchFailuresBeforeReporting' failures
        private void checkAndInformJobTracker(
            int failures, TaskAttemptID mapId, boolean readError,
            boolean connectExcpt) {
          if (connectExcpt || (reportReadErrorImmediately && readError)
              || ((failures % maxFetchFailuresBeforeReporting) == 0)) {
            LOG.info("Reporting fetch failure for " + mapId + " to jobtracker.");
            status.addFetchFailedMap((org.apache.hadoop.mapred.TaskAttemptID) mapId);
          }
        }
      
       

      Attachments

        1. MAPREDUCE-5335-1.patch
          2 kB
          Devaraj Kavali
        2. MAPREDUCE-5335.patch
          2 kB
          Devaraj Kavali

        Activity

          People

            devaraj Devaraj Kavali
            devaraj Devaraj Kavali
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: