Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-7428

Add containerId to Localizer failed logs

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.7.3
    • 3.0.0, 3.1.0, 2.10.0
    • nodemanager
    • None

    Description

      When a Localizer fails for some reason, the error message does not have the containerId to correlate.

      2017-10-31 00:03:11,046 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor: IOException executing command:
      java.io.InterruptedIOException: java.lang.InterruptedException
              at org.apache.hadoop.util.Shell.runCommand(Shell.java:947)
              at org.apache.hadoop.util.Shell.run(Shell.java:848)
              at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1142)
              at org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.privileged.PrivilegedOperationExecutor.executePrivilegedOperation(PrivilegedOperationExecutor.java:151)
              at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.startLocalizer(LinuxContainerExecutor.java:264)
              at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:1114)
      Caused by: java.lang.InterruptedException
              at java.lang.Object.wait(Native Method)
              at java.lang.Object.wait(Object.java:502)
              at java.lang.UNIXProcess.waitFor(UNIXProcess.java:396)
              at org.apache.hadoop.util.Shell.runCommand(Shell.java:937)
              ... 5 more
      2017-10-31 00:03:11,047 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService: Localizer failed
      java.lang.NullPointerException
      

      Attachments

        1. YARN-7428.1.patch
          1 kB
          Prabhu Joseph

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            prabhujoseph Prabhu Joseph
            prabhujoseph Prabhu Joseph
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment