Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1131

Using profilers other than hprof can cause JobClient to report job failure

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: client
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If task profiling is enabled, the JobClient will download the profile.out file created by the tasks under profile. If this causes an IOException, the job is reported as a failure to the client, even though all the tasks themselves may complete successfully. The expected result files are assumed to be generated by hprof. Using the profiling system with other profilers will cause job failure.

      1. MAPREDUCE-1131.2.patch
        8 kB
        Aaron Kimball
      2. MAPREDUCE-1131.3.patch
        8 kB
        Aaron Kimball
      3. MAPREDUCE-1131.4.patch
        4 kB
        Aaron Kimball
      4. MAPREDUCE-1131.5.patch
        4 kB
        Aaron Kimball
      5. MAPREDUCE-1131.6.patch
        7 kB
        Aaron Kimball
      6. MAPREDUCE-1131.patch
        7 kB
        Aaron Kimball

        Issue Links

          Activity

          Aaron Kimball created issue -
          Aaron Kimball made changes -
          Field Original Value New Value
          Attachment MAPREDUCE-1131.patch [ 12422859 ]
          Aaron Kimball made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Aaron Kimball made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Aaron Kimball made changes -
          Attachment MAPREDUCE-1131.2.patch [ 12422863 ]
          Aaron Kimball made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Aaron Kimball made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Aaron Kimball made changes -
          Attachment MAPREDUCE-1131.3.patch [ 12422866 ]
          Aaron Kimball made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Link This issue relates to MAPREDUCE-105 [ MAPREDUCE-105 ]
          Aaron Kimball made changes -
          Attachment MAPREDUCE-1131.4.patch [ 12424425 ]
          Aaron Kimball made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Aaron Kimball made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Aaron Kimball made changes -
          Attachment MAPREDUCE-1131.5.patch [ 12424426 ]
          Aaron Kimball made changes -
          Attachment MAPREDUCE-1131.6.patch [ 12427970 ]
          Aaron Kimball made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Aaron Kimball made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Tom White made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.22.0 [ 12314184 ]
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12314045 ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Aaron Kimball
              Reporter:
              Aaron Kimball
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development