Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9149

yarn container -status misses logUrl when integrated with ATSv2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • None
    • None
    • Reviewed

    Description

      Post YARN-8303, yarn client can be integrated with ATSv2. But log url and start and end time is printing data is wrong!

      Container Report :
      	Container-Id : container_1545035586969_0001_01_000001
      	Start-Time : 0
      	Finish-Time : 0
      	State : COMPLETE
      	Execution-Type : GUARANTEED
      	LOG-URL : null
      	Host : localhost:25006
      	NodeHttpAddress : localhost:25008
      	Diagnostics :
      
      1. TimelineEntityV2Converter#convertToContainerReport set logUrl as null. This need set for proper log url based on yarn.log.server.web-service.url
      2. TimelineEntityV2Converter#convertToContainerReport parses start/end time wrongly. Comparison should happen with entityType but below code is doing entityId
            if (events != null) {
              for (TimelineEvent event : events) {
                if (event.getId().equals(
                    ContainerMetricsConstants.CREATED_IN_RM_EVENT_TYPE)) {
                  createdTime = event.getTimestamp();
                } else if (event.getId().equals(
                    ContainerMetricsConstants.FINISHED_IN_RM_EVENT_TYPE)) {
                  finishedTime = event.getTimestamp();
                }
              }
            }
        

      Attachments

        1. YARN-9149.003.patch
          7 kB
          Abhishek Modi
        2. YARN-9149.002.patch
          7 kB
          Abhishek Modi
        3. YARN-9149.001.patch
          7 kB
          Abhishek Modi

        Activity

          People

            abmodi Abhishek Modi
            rohithsharma Rohith Sharma K S
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: