Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1131

Using profilers other than hprof can cause JobClient to report job failure

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.21.0
    • client
    • None
    • Reviewed

    Description

      If task profiling is enabled, the JobClient will download the profile.out file created by the tasks under profile. If this causes an IOException, the job is reported as a failure to the client, even though all the tasks themselves may complete successfully. The expected result files are assumed to be generated by hprof. Using the profiling system with other profilers will cause job failure.

      Attachments

        1. MAPREDUCE-1131.2.patch
          8 kB
          Aaron Kimball
        2. MAPREDUCE-1131.3.patch
          8 kB
          Aaron Kimball
        3. MAPREDUCE-1131.4.patch
          4 kB
          Aaron Kimball
        4. MAPREDUCE-1131.5.patch
          4 kB
          Aaron Kimball
        5. MAPREDUCE-1131.6.patch
          7 kB
          Aaron Kimball
        6. MAPREDUCE-1131.patch
          7 kB
          Aaron Kimball

        Issue Links

          relates to

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-105 Handling of mapred.task.profile.params is hprof specific

          • Major - Major loss of function.
          • Open

          Activity

            People

              kimballa Aaron Kimball
              kimballa Aaron Kimball
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: