Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5715

ProcfsBasedProcessTree#constructProcessInfo() can still throw NumberFormatException

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      Ubuntu 13.04 (OS Kernel 3.9.0), Armv71Exynos5440

      Description

      For long running jobs I have hit an issue that seems to be to be similar to the bug reported in https://issues.apache.org/jira/browse/MAPREDUCE-3583

      Unfortunately I do not have the OS logs for this issue, but the utime for the application was read by Hadoop as "184467440737095551615" which does not fit into a Long. In MAPREDUCE-3583 a change was made to ProcfsBasedProcessTree.java
      in order to support larger values for stime. Perhaps we need to support larger values for utime (although this could increase the complexity of the math that is being performed on those numbers)

        Attachments

        1. constructprocessfailing.jpg
          155 kB
          German Florez-Larrahondo

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                gflarrahondo German Florez-Larrahondo
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: