Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-431 [Umbrella] Complete/Stabilize YARN application log-handling
  3. YARN-7027

Log aggregation finish time should get logged for trouble shooting.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • log-aggregation
    • None

    Description

      Now, RM track application log aggregation status in RMApp and the status change is triggered by NM heartbeat with log aggregation report. For each node's log aggregation status change from in-progress (NOT_START,RUNNING,RUNNING_WITH_FAILURE) to final status (SUCCEEDED,FAILED, TIMEOUT), it trigger an aggregation for log aggregation status: updateLogAggregationStatus(). The whole progress is log less and we cannot trace the log aggregation problem (delay of log aggregation, etc.) from RM (or NM) log. We should add more log here.

      Attachments

        Activity

          People

            junping_du Junping Du
            junping_du Junping Du
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: