Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4130

Jobid creation is not required if the job failed because of unavailability of input path.Can input and output paths validation can be done before job ID creation step?

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • mrv2
    • None

    Description

      If the input splits cannot be computed because the input paths doesnt exist
      Job is not submitted and error is thrown.But before that jobid is created which can be avoided.
      The sequence is
      1)Output path validation
      2)Jobid creation
      3)Input splits computation

      But if the sequence of steps is 1,3,2 ...unnecessary jobid creation can be avoided

      Attachments

        Activity

          People

            Unassigned Unassigned
            ramgopalnaali Ramgopal N
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: