Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.20.203.0
    • Fix Version/s: 1.0.3, 2.0.0-alpha
    • Component/s: None
    • Labels:
      None
    • Environment:

      0.20.203.0 standalone JDK 1.6 Linux

      Description

      I have an OutputFormat which implements Configurable. I set new config entries to a job configuration during checkOutputSpec() so that the tasks will get the config entries through the job configuration. This works fine in 0.20.2, but stopped working starting from 0.20.203. With 0.20.203, my OutputFormat still has the configuration set, but the copy a task gets does not have the new entries that are set as part of checkOutputSpec().

      I believe that the problem is with JobClient. The job configuration needs to wait till checkOutputSpec() is returned before being cloned and submitted.

      1. mapreduce-3377.patch
        6 kB
        Jane Chen
      2. mapreduce-3377-branch-1.patch
        6 kB
        Jane Chen
      3. mapreduce-3377.patch
        6 kB
        Jane Chen
      4. err-after
        13 kB
        Jane Chen
      5. err-before
        13 kB
        Jane Chen
      6. out-after
        136 kB
        Jane Chen
      7. out-before
        136 kB
        Jane Chen
      8. mapreduce-3377-branch-1.patch
        6 kB
        Jane Chen
      9. mapreduce-3377.patch
        6 kB
        Jane Chen
      10. mapreduce-3377.patch
        1 kB
        Jane Chen

        Issue Links

          Activity

            People

            • Assignee:
              Jane Chen
              Reporter:
              Jane Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development