Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-463

The job setup and cleanup tasks should be optional

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true.
      Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration.
      If the configuration is set to false, no setup or cleanup will be done.
      Show
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true. Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration. If the configuration is set to false, no setup or cleanup will be done.

      Description

      For jobs that require low latency and do not require setup or cleanup tasks for the job, it should be possible to turn them off for that job.

        Attachments

        1. patch-5785.txt
          25 kB
          Amareshwari Sriramadasu
        2. patch-5785-1.txt
          25 kB
          Amareshwari Sriramadasu
        3. patch-5785-2.txt
          26 kB
          Amareshwari Sriramadasu
        4. patch-5785-3.txt
          28 kB
          Amareshwari Sriramadasu
        5. patch-5785-4.txt
          32 kB
          Amareshwari Sriramadasu
        6. patch-5785-5.txt
          32 kB
          Amareshwari Sriramadasu
        7. patch-463.txt
          32 kB
          Amareshwari Sriramadasu
        8. patch-463-1.txt
          32 kB
          Amareshwari Sriramadasu

          Issue Links

            Activity

              People

              • Assignee:
                amareshwari Amareshwari Sriramadasu
                Reporter:
                owen.omalley Owen O'Malley
              • Votes:
                3 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: