Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4795

ContainerMetrics drops records

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.9.0
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: resourcemanager
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The metrics2 system was implemented to deal with persistent sources. ContainerMetrics is an ephemeral source, and so it causes problems. Specifically, the ContainerMetrics only reports metrics once after the container has been stopped. This behavior is a problem because the metrics2 system can ask sources for reports that will be quietly dropped by the sinks that care. (It's a metrics2 feature, not a bug.) If that final report is silently dropped, it's lost, because the ContainerMetrics won't report anything else ever anymore.

        Attachments

        1. YARN-4795.001.patch
          4 kB
          Daniel Templeton
        2. YARN-4795.002.patch
          4 kB
          Daniel Templeton

        Issue Links

          Activity

            People

            • Assignee:
              templedf Daniel Templeton
              Reporter:
              templedf Daniel Templeton

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment