Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-11020

[UI2] No container is found for an application attempt with a single AM container

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      In UI2 for an application under the Logs tab, No container data available message is shown if the application attempt only submitted a single container (which is the AM container). 

      The culprit of the issue is that the response from YARN is not consistent, because for a single container it looks like:

      {
          "containerLogsInfo": {
              "containerLogInfo": [
                  {
                      "fileName": "prelaunch.out",
                      "fileSize": "100",
                      "lastModifiedTime": "Mon Nov 29 09:28:16 +0000 2021"
                  },
                  {
                      "fileName": "directory.info",
                      "fileSize": "2296",
                      "lastModifiedTime": "Mon Nov 29 09:28:16 +0000 2021"
                  },
                  {
                      "fileName": "stderr",
                      "fileSize": "1722",
                      "lastModifiedTime": "Mon Nov 29 09:28:28 +0000 2021"
                  },
                  {
                      "fileName": "prelaunch.err",
                      "fileSize": "0",
                      "lastModifiedTime": "Mon Nov 29 09:28:16 +0000 2021"
                  },
                  {
                      "fileName": "stdout",
                      "fileSize": "0",
                      "lastModifiedTime": "Mon Nov 29 09:28:16 +0000 2021"
                  },
                  {
                      "fileName": "syslog",
                      "fileSize": "38551",
                      "lastModifiedTime": "Mon Nov 29 09:28:28 +0000 2021"
                  },
                  {
                      "fileName": "launch_container.sh",
                      "fileSize": "5013",
                      "lastModifiedTime": "Mon Nov 29 09:28:16 +0000 2021"
                  }
              ],
              "logAggregationType": "AGGREGATED",
              "containerId": "container_1638174027957_0008_01_000001",
              "nodeId": "da175178c179:43977"
          }
      }

      As for applications with multiple containers it looks like:

      {
          "containerLogsInfo": [{
              ....
          }, { .... }]
      }

      We can not change the response of the endpoint due to backward compatibility, therefore we need to make UI2 be able to handle both scenarios.

      Attachments

        1. YARN-11020-branch-3.3.001.patch
          0.8 kB
          Andras Gyori

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            gandras Andras Gyori
            gandras Andras Gyori
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 1h
                1h

                Slack

                  Issue deployment