Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3154

Validate the Jobs Output Specification as the first statement in JobSubmitter.submitJobInternal(Job, Cluster) method

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha
    • 0.23.0
    • client, mrv2
    • None
    • mrv2

    Description

      Presently the output specification is validated after getting new JobId from ClientRMService, Copying the job jar, Configuration file, archives etc.

      Instead of that move following Job Output specification validation call to the begining of JobSubmitter.submitJobInternal(Job, Cluster) method.

      checkSpecs(job);
      

      This will avoid unnecessary work in case of invalid output specs.

      Attachments

        1. MAPREDUCE-3154.patch
          1 kB
          Abhijit Suresh Shingate

        Issue Links

          Activity

            People

              abhijit.shingate Abhijit Suresh Shingate
              abhijit.shingate Abhijit Suresh Shingate
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 1h
                  1h
                  Remaining:
                  Remaining Estimate - 1h
                  1h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified