Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-463

The job setup and cleanup tasks should be optional

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true.
      Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration.
      If the configuration is set to false, no setup or cleanup will be done.
      Show
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true. Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration. If the configuration is set to false, no setup or cleanup will be done.

      Description

      For jobs that require low latency and do not require setup or cleanup tasks for the job, it should be possible to turn them off for that job.

      1. patch-463.txt
        32 kB
        Amareshwari Sriramadasu
      2. patch-463-1.txt
        32 kB
        Amareshwari Sriramadasu
      3. patch-5785.txt
        25 kB
        Amareshwari Sriramadasu
      4. patch-5785-1.txt
        25 kB
        Amareshwari Sriramadasu
      5. patch-5785-2.txt
        26 kB
        Amareshwari Sriramadasu
      6. patch-5785-3.txt
        28 kB
        Amareshwari Sriramadasu
      7. patch-5785-4.txt
        32 kB
        Amareshwari Sriramadasu
      8. patch-5785-5.txt
        32 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Amareshwari Sriramadasu
              Reporter:
              Owen O'Malley
            • Votes:
              3 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development