Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5335

Rename Job Tracker terminology in ShuffleSchedulerImpl

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: applicationmaster
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      2013-06-17 17:27:30,134 INFO [fetcher#2] org.apache.hadoop.mapreduce.task.reduce.ShuffleScheduler: Reporting fetch failure for attempt_1371467533091_0005_m_000010_0 to jobtracker.
      
      ShuffleSchedulerImpl.java
        // Notify the JobTracker
        // after every read error, if 'reportReadErrorImmediately' is true or
        // after every 'maxFetchFailuresBeforeReporting' failures
        private void checkAndInformJobTracker(
            int failures, TaskAttemptID mapId, boolean readError,
            boolean connectExcpt) {
          if (connectExcpt || (reportReadErrorImmediately && readError)
              || ((failures % maxFetchFailuresBeforeReporting) == 0)) {
            LOG.info("Reporting fetch failure for " + mapId + " to jobtracker.");
            status.addFetchFailedMap((org.apache.hadoop.mapred.TaskAttemptID) mapId);
          }
        }
      
       

        Attachments

        1. MAPREDUCE-5335.patch
          2 kB
          Devaraj Kavali
        2. MAPREDUCE-5335-1.patch
          2 kB
          Devaraj Kavali

          Activity

            People

            • Assignee:
              devaraj Devaraj Kavali
              Reporter:
              devaraj Devaraj Kavali
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: