Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5700

historyServer can't show container's log when aggregation is not enabled

    Details

    • Type: Improvement Improvement
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.23.7, 2.0.4-alpha, 2.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Environment:

      yarn.log-aggregation-enable=false , HistoryServer will show like this:

      Aggregation is not enabled. Try the nodemanager at hd13-vm1:34669

      Description

      When yarn.log-aggregation-enable is seted to false, after a MR_App complete, we can't view the container's log from the HistoryServer, it shows message like:
      Aggregation is not enabled. Try the nodemanager at hd13-vm1:34669

      Since we don't want to aggregate the container's log, because it will be a pressure to namenode. but sometimes we also want to take a look at container's log.
      Should we show the container's log across HistoryServer even if yarn.log-aggregation-enable is seted to false.

      1. yarn-647.patch
        3 kB
        Hong Shen
      2. yarn-647-2.patch
        3 kB
        Hong Shen

        Activity

          People

          • Assignee:
            Hong Shen
            Reporter:
            Hong Shen
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:

              Development