Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4969

Fix more loggings in CapacityScheduler

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • capacity scheduler

    Description

      YARN-3966 did logging cleanup for Capacity Scheduler before, however, there're some loggings we need to improvement:

      Container allocation / complete / reservation / un-reserve messages for every hierarchy (app/leaf/parent-queue) should be printed at INFO level:
      I'm debugging one issue that root queue's resource usage could be negative, it is very hard to reproduce, so we cannot enable debug logging since RM start, size of log cannot be fit in a single disk.

      Existing CS prints INFO message when container cannot be allocated, such as re-reservation / node heartbeat, etc. we should avoid printing such message at INFO level.

      Attachments

        1. YARN-4969.1.patch
          10 kB
          Wangda Tan

        Activity

          People

            leftnoteasy Wangda Tan
            leftnoteasy Wangda Tan
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated: