Details

    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Currently, when application is finished, NM will start to do the log aggregation. But for Long running service applications, this is not ideal. The problems we have are:
      1) LRS applications are expected to run for a long time (weeks, months).
      2) Currently, all the container logs (from one NM) will be written into a single file. The files could become larger and larger.

        Attachments

        1. YARN-2468.11.patch
          61 kB
          Xuan Gong
        2. YARN-2468.10.patch
          61 kB
          Xuan Gong
        3. YARN-2468.9.1.patch
          61 kB
          Xuan Gong
        4. YARN-2468.9.patch
          61 kB
          Xuan Gong
        5. YARN-2468.8.patch
          53 kB
          Xuan Gong
        6. YARN-2468.7.1.patch
          54 kB
          Xuan Gong
        7. YARN-2468.7.patch
          54 kB
          Xuan Gong
        8. YARN-2468.6.1.patch
          108 kB
          Xuan Gong
        9. YARN-2468.6.patch
          107 kB
          Xuan Gong
        10. YARN-2468.5.4.patch
          95 kB
          Xuan Gong
        11. YARN-2468.5.3.patch
          95 kB
          Xuan Gong
        12. YARN-2468.5.2.patch
          85 kB
          Xuan Gong
        13. YARN-2468.5.1.patch
          96 kB
          Xuan Gong
        14. YARN-2468.5.1.patch
          100 kB
          Xuan Gong
        15. YARN-2468.5.patch
          96 kB
          Xuan Gong
        16. YARN-2468.4.1.patch
          103 kB
          Xuan Gong
        17. YARN-2468.4.patch
          98 kB
          Xuan Gong
        18. YARN-2468.3.rebase.2.patch
          98 kB
          Xuan Gong
        19. YARN-2468.3.rebase.patch
          97 kB
          Xuan Gong
        20. YARN-2468.3.patch
          97 kB
          Xuan Gong
        21. YARN-2468.2.patch
          95 kB
          Xuan Gong
        22. YARN-2468.1.patch
          91 kB
          Xuan Gong

          Issue Links

            Activity

              People

              • Assignee:
                xgong Xuan Gong
                Reporter:
                xgong Xuan Gong
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: