Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10608

Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: log-aggregation
    • Labels:
      None
    • Target Version/s:

      Description

      Now the yarn.nodemanager.delete.debug-delay-sec is a cluster level setting.

      In our busy production cluster, we set it to 0 default for preventing local log boom.

      But when we need deep into some spark/MR etc jobs errors such as core dump, i advice to support enable a job level setting for delay of deletion for local logs for reproduce the error.

       

      Wangda Tan Zhankun Tang  Xuan Gong Eric Payne

      If you any advice about this support?

        Attachments

          Activity

            People

            • Assignee:
              zhuqi Qi Zhu
              Reporter:
              zhuqi Qi Zhu
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: