Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-463

The job setup and cleanup tasks should be optional

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None
    • Reviewed
    • Hide
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true.
      Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration.
      If the configuration is set to false, no setup or cleanup will be done.
      Show
      Added Configuration property "mapred.committer.job.setup.cleanup.needed" to specify whether job-setup and job-cleanup is needed for the job output committer. The default value is true. Added Job.setJobSetupCleanupNeeded and JobContext.getJobSetupCleanupNeeded api for setting/getting the configuration. If the configuration is set to false, no setup or cleanup will be done.

    Description

      For jobs that require low latency and do not require setup or cleanup tasks for the job, it should be possible to turn them off for that job.

      Attachments

        1. patch-463.txt
          32 kB
          Amareshwari Sriramadasu
        2. patch-463-1.txt
          32 kB
          Amareshwari Sriramadasu
        3. patch-5785.txt
          25 kB
          Amareshwari Sriramadasu
        4. patch-5785-1.txt
          25 kB
          Amareshwari Sriramadasu
        5. patch-5785-2.txt
          26 kB
          Amareshwari Sriramadasu
        6. patch-5785-3.txt
          28 kB
          Amareshwari Sriramadasu
        7. patch-5785-4.txt
          32 kB
          Amareshwari Sriramadasu
        8. patch-5785-5.txt
          32 kB
          Amareshwari Sriramadasu

        Issue Links

          Activity

            People

              amareshwari Amareshwari Sriramadasu
              omalley Owen O'Malley
              Votes:
              3 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: