Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-522 [Umbrella] Better reporting for crashed/Killed AMs and Containers
  3. YARN-857

Localization failures should be available in container diagnostics

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 3.0.0-alpha1
    • None
    • None

    Description

      at org.apache.hadoop.yarn.server.nodemanager.api.impl.pb.client.LocalizationProtocolPBClientImpl.heartbeat(LocalizationProtocolPBClientImpl.java:62)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.localizeFiles(ContainerLocalizer.java:235)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ContainerLocalizer.runLocalization(ContainerLocalizer.java:169)
      at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.startLocalizer(DefaultContainerExecutor.java:106)
      at org.apache.hadoop.yarn.server.nodemanager.containermanager.localizer.ResourceLocalizationService$LocalizerRunner.run(ResourceLocalizationService.java:978)

      Traced this down to DefaultExecutor which does not look at the exit code for the localizer.

      Attachments

        1. YARN-857.1.patch
          3 kB
          Hitesh Shah
        2. YARN-857.2.patch
          5 kB
          Vinod Kumar Vavilapalli
        3. YARN-857-20160404.txt
          7 kB
          Vinod Kumar Vavilapalli
        4. YARN-857-20160405.txt
          8 kB
          Vinod Kumar Vavilapalli
        5. YARN-857-20160515.txt
          23 kB
          Vinod Kumar Vavilapalli
        6. YARN-857-20160520.txt
          23 kB
          Vinod Kumar Vavilapalli

        Activity

          People

            vinodkv Vinod Kumar Vavilapalli
            hitesh Hitesh Shah
            Votes:
            0 Vote for this issue
            Watchers:
            11 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: