Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5139 [Umbrella] Move YARN scheduler towards global scheduler
  3. YARN-8479

The capacity scheduler logs too frequently seriously affecting performance

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:
      None

      Description

      The capacity scheduler logs too frequently, seriously affecting performance.

      As a result of our test that the scheduling speed of capacity scheduler is difficult to reach 5000/s in the production scenario.

      And it will soon reach the log bottleneck.

      My current work is to change many log levels from INFO to DEBUG level.

      Wangda Tan Wangda Tan Any suggestion?

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                daemon YunFan Zhou
                Reporter:
                daemon YunFan Zhou
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: