Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2443 Handling logs of long-running services on YARN
  3. YARN-2703

Add logUploadedTime into LogValue for better display

VotersWatch issueWatchersLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.6.0
    • None
    • Reviewed

    Description

      Right now, the container can upload its logs multiple times. Sometimes, containers write different logs into the same log file. After the log aggregation, when we query those logs, it will show:

      LogType: stderr
      LogContext:

      LogType: stdout
      LogContext:

      LogType: stderr
      LogContext:

      LogType: stdout
      LogContext:

      The same files could be displayed multiple times. But we can not figure out which logs come first. We could add extra loguploadedTime to let users have better understanding on the logs.

      Attachments

        1. YARN-2703.1.patch
          11 kB
          Xuan Gong
        2. YARN-2703.2.patch
          16 kB
          Xuan Gong
        3. YARN-2703.3.patch
          11 kB
          Xuan Gong
        4. YARN-2703.4.patch
          10 kB
          Xuan Gong

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            xgong Xuan Gong
            xgong Xuan Gong
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment