Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4662

JobHistoryFilesManager thread pool never expands

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.2
    • Fix Version/s: 1.2.0
    • Component/s: jobhistoryserver
    • Labels:
      None
    • Target Version/s:

      Description

      The job history file manager creates a threadpool with core size 1 thread, max pool size 3. It never goes beyond 1 thread though because its using a LinkedBlockingQueue which doesn't have a max size.

      void start()

      { executor = new ThreadPoolExecutor(1, 3, 1, TimeUnit.HOURS, new LinkedBlockingQueue<Runnable>()); }

      According to the ThreadPoolExecutor java doc page it only increases the number of threads when the queue is full. Since the queue we are using has no max size it never fills up and we never get more then 1 thread.

      1. mapreduce-4662.branch-1.patch
        0.7 kB
        Kihwal Lee
      2. mapreduce-4662.branch-1.patch
        0.7 kB
        Kihwal Lee

        Issue Links

          Activity

            People

            • Assignee:
              Kihwal Lee
              Reporter:
              Thomas Graves
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development