Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1131

Using profilers other than hprof can cause JobClient to report job failure

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If task profiling is enabled, the JobClient will download the profile.out file created by the tasks under profile. If this causes an IOException, the job is reported as a failure to the client, even though all the tasks themselves may complete successfully. The expected result files are assumed to be generated by hprof. Using the profiling system with other profilers will cause job failure.

        Attachments

        1. MAPREDUCE-1131.6.patch
          7 kB
          Aaron Kimball
        2. MAPREDUCE-1131.5.patch
          4 kB
          Aaron Kimball
        3. MAPREDUCE-1131.4.patch
          4 kB
          Aaron Kimball
        4. MAPREDUCE-1131.3.patch
          8 kB
          Aaron Kimball
        5. MAPREDUCE-1131.2.patch
          8 kB
          Aaron Kimball
        6. MAPREDUCE-1131.patch
          7 kB
          Aaron Kimball

          Issue Links

            Activity

              People

              • Assignee:
                kimballa Aaron Kimball
                Reporter:
                kimballa Aaron Kimball
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: