Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-867

job client should generate input fragments before the job is submitted

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.0
    • Component/s: None
    • Labels:
      None

      Description

      The JobClient should generate the input fragments and write them to dfs next to the job.xml parallel to the job.xml. This would offload the JobTracker, get rid of the job state where the job isn't initialized yet, and fix the problem with the class path for job initialization.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: