Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3154

Validate the Jobs Output Specification as the first statement in JobSubmitter.submitJobInternal(Job, Cluster) method

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0, 2.0.0-alpha
    • Fix Version/s: 0.23.0
    • Component/s: client, mrv2
    • Labels:
      None
    • Environment:

      mrv2

      Description

      Presently the output specification is validated after getting new JobId from ClientRMService, Copying the job jar, Configuration file, archives etc.

      Instead of that move following Job Output specification validation call to the begining of JobSubmitter.submitJobInternal(Job, Cluster) method.

      checkSpecs(job);
      

      This will avoid unnecessary work in case of invalid output specs.

        Attachments

        1. MAPREDUCE-3154.patch
          1 kB
          Abhijit Suresh Shingate

          Issue Links

            Activity

              People

              • Assignee:
                abhijit.shingate Abhijit Suresh Shingate
                Reporter:
                abhijit.shingate Abhijit Suresh Shingate
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Due:
                  Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - 1h
                  1h
                  Remaining:
                  Remaining Estimate - 1h
                  1h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified