Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3377

Compatibility issue with 0.20.203.

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.20.203.0
    • 1.0.3, 2.0.0-alpha
    • None
    • None
    • 0.20.203.0 standalone JDK 1.6 Linux

    Description

      I have an OutputFormat which implements Configurable. I set new config entries to a job configuration during checkOutputSpec() so that the tasks will get the config entries through the job configuration. This works fine in 0.20.2, but stopped working starting from 0.20.203. With 0.20.203, my OutputFormat still has the configuration set, but the copy a task gets does not have the new entries that are set as part of checkOutputSpec().

      I believe that the problem is with JobClient. The job configuration needs to wait till checkOutputSpec() is returned before being cloned and submitted.

      Attachments

        1. mapreduce-3377.patch
          1 kB
          Jane Chen
        2. mapreduce-3377.patch
          6 kB
          Jane Chen
        3. mapreduce-3377-branch-1.patch
          6 kB
          Jane Chen
        4. out-before
          136 kB
          Jane Chen
        5. out-after
          136 kB
          Jane Chen
        6. err-before
          13 kB
          Jane Chen
        7. err-after
          13 kB
          Jane Chen
        8. mapreduce-3377.patch
          6 kB
          Jane Chen
        9. mapreduce-3377-branch-1.patch
          6 kB
          Jane Chen
        10. mapreduce-3377.patch
          6 kB
          Jane Chen

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jxchen Jane Chen
            jxchen Jane Chen
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment