Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9149

yarn container -status misses logUrl when integrated with ATSv2

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Post YARN-8303, yarn client can be integrated with ATSv2. But log url and start and end time is printing data is wrong!

      Container Report :
      	Container-Id : container_1545035586969_0001_01_000001
      	Start-Time : 0
      	Finish-Time : 0
      	State : COMPLETE
      	Execution-Type : GUARANTEED
      	LOG-URL : null
      	Host : localhost:25006
      	NodeHttpAddress : localhost:25008
      	Diagnostics :
      
      1. TimelineEntityV2Converter#convertToContainerReport set logUrl as null. This need set for proper log url based on yarn.log.server.web-service.url
      2. TimelineEntityV2Converter#convertToContainerReport parses start/end time wrongly. Comparison should happen with entityType but below code is doing entityId
            if (events != null) {
              for (TimelineEvent event : events) {
                if (event.getId().equals(
                    ContainerMetricsConstants.CREATED_IN_RM_EVENT_TYPE)) {
                  createdTime = event.getTimestamp();
                } else if (event.getId().equals(
                    ContainerMetricsConstants.FINISHED_IN_RM_EVENT_TYPE)) {
                  finishedTime = event.getTimestamp();
                }
              }
            }
        

        Attachments

        1. YARN-9149.003.patch
          7 kB
          Abhishek Modi
        2. YARN-9149.002.patch
          7 kB
          Abhishek Modi
        3. YARN-9149.001.patch
          7 kB
          Abhishek Modi

          Activity

            People

            • Assignee:
              abmodi Abhishek Modi
              Reporter:
              rohithsharma Rohith Sharma K S

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment