Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-867

job client should generate input fragments before the job is submitted

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.12.0
    • None
    • None

    Description

      The JobClient should generate the input fragments and write them to dfs next to the job.xml parallel to the job.xml. This would offload the JobTracker, get rid of the job state where the job isn't initialized yet, and fix the problem with the class path for job initialization.

      Attachments

        Activity

          People

            Unassigned Unassigned
            omalley Owen O'Malley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: