Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-7027

Log aggregation finish time should get logged for trouble shooting.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: log-aggregation
    • Labels:
      None
    • Target Version/s:

      Description

      Now, RM track application log aggregation status in RMApp and the status change is triggered by NM heartbeat with log aggregation report. For each node's log aggregation status change from in-progress (NOT_START,RUNNING,RUNNING_WITH_FAILURE) to final status (SUCCEEDED,FAILED, TIMEOUT), it trigger an aggregation for log aggregation status: updateLogAggregationStatus(). The whole progress is log less and we cannot trace the log aggregation problem (delay of log aggregation, etc.) from RM (or NM) log. We should add more log here.

        Attachments

          Activity

            People

            • Assignee:
              junping_du Junping Du
              Reporter:
              junping_du Junping Du
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: