Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1131

Using profilers other than hprof can cause JobClient to report job failure

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • client
    • None
    • Reviewed

    Description

      If task profiling is enabled, the JobClient will download the profile.out file created by the tasks under profile. If this causes an IOException, the job is reported as a failure to the client, even though all the tasks themselves may complete successfully. The expected result files are assumed to be generated by hprof. Using the profiling system with other profilers will cause job failure.

      Attachments

        1. MAPREDUCE-1131.2.patch
          8 kB
          Aaron Kimball
        2. MAPREDUCE-1131.3.patch
          8 kB
          Aaron Kimball
        3. MAPREDUCE-1131.4.patch
          4 kB
          Aaron Kimball
        4. MAPREDUCE-1131.5.patch
          4 kB
          Aaron Kimball
        5. MAPREDUCE-1131.6.patch
          7 kB
          Aaron Kimball
        6. MAPREDUCE-1131.patch
          7 kB
          Aaron Kimball

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            kimballa Aaron Kimball
            kimballa Aaron Kimball
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment