Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9676

Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0, 3.2.1
    • Component/s: None
    • Labels:
      None

      Description

      During the development of the last items of YARN-6875, it was typically difficult to extract information about the internal state of some log aggregation related classes (e.g. AppLogAggregatiorImpl and LogAggregationFileController).

      On my fork I added a few more messages to those classes like:

      • displaying the number of log aggregation cycles
      • displaying the names of the files currently considered for log aggregation by containers
      • immediately displaying any exception caught (and sent to the RM in the diagnostic messages) during the log aggregation process.

      Those messages were quite useful for debugging if any issue occurs, but otherwise it flooded the NM log file with these messages that are usually not needed. I suggest to add (some of) these messages in DEBUG or TRACE level.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                adam.antal Adam Antal
                Reporter:
                adam.antal Adam Antal
              • Votes:
                1 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: