Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4662

JobHistoryFilesManager thread pool never expands

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.2
    • 1.2.0
    • jobhistoryserver
    • None

    Description

      The job history file manager creates a threadpool with core size 1 thread, max pool size 3. It never goes beyond 1 thread though because its using a LinkedBlockingQueue which doesn't have a max size.

      void start()

      { executor = new ThreadPoolExecutor(1, 3, 1, TimeUnit.HOURS, new LinkedBlockingQueue<Runnable>()); }

      According to the ThreadPoolExecutor java doc page it only increases the number of threads when the queue is full. Since the queue we are using has no max size it never fills up and we never get more then 1 thread.

      Attachments

        1. mapreduce-4662.branch-1.patch
          0.7 kB
          Kihwal Lee
        2. mapreduce-4662.branch-1.patch
          0.7 kB
          Kihwal Lee

        Issue Links

          Activity

            People

              kihwal Kihwal Lee
              tgraves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: