Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5139 [Umbrella] Move YARN scheduler towards global scheduler
  3. YARN-8479

The capacity scheduler logs too frequently seriously affecting performance

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Critical
    • Resolution: Unresolved
    • None
    • None
    • capacity scheduler, capacityscheduler
    • None

    Description

      The capacity scheduler logs too frequently, seriously affecting performance.

      As a result of our test that the scheduling speed of capacity scheduler is difficult to reach 5000/s in the production scenario.

      And it will soon reach the log bottleneck.

      My current work is to change many log levels from INFO to DEBUG level.

      wangda leftnoteasy Any suggestion?

       

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. YARN-8478 The capacity scheduler logs too frequently seriously affecting performance

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              daemon YunFan Zhou
              daemon YunFan Zhou
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated: