Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5700

historyServer can't show container's log when aggregation is not enabled

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.23.7, 2.0.4-alpha, 2.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Environment:

      yarn.log-aggregation-enable=false , HistoryServer will show like this:

      Aggregation is not enabled. Try the nodemanager at hd13-vm1:34669

      Description

      When yarn.log-aggregation-enable is seted to false, after a MR_App complete, we can't view the container's log from the HistoryServer, it shows message like:
      Aggregation is not enabled. Try the nodemanager at hd13-vm1:34669

      Since we don't want to aggregate the container's log, because it will be a pressure to namenode. but sometimes we also want to take a look at container's log.
      Should we show the container's log across HistoryServer even if yarn.log-aggregation-enable is seted to false.

        Attachments

        1. yarn-647.patch
          3 kB
          Hong Shen
        2. yarn-647-2.patch
          3 kB
          Hong Shen

          Activity

            People

            • Assignee:
              shenhong Hong Shen
              Reporter:
              shenhong Hong Shen
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: