Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4662

JobHistoryFilesManager thread pool never expands

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.0.2
    • Fix Version/s: 1.2.0
    • Component/s: jobhistoryserver
    • Labels:
      None
    • Target Version/s:

      Description

      The job history file manager creates a threadpool with core size 1 thread, max pool size 3. It never goes beyond 1 thread though because its using a LinkedBlockingQueue which doesn't have a max size.

      void start()

      { executor = new ThreadPoolExecutor(1, 3, 1, TimeUnit.HOURS, new LinkedBlockingQueue<Runnable>()); }

      According to the ThreadPoolExecutor java doc page it only increases the number of threads when the queue is full. Since the queue we are using has no max size it never fills up and we never get more then 1 thread.

      1. mapreduce-4662.branch-1.patch
        0.7 kB
        Kihwal Lee
      2. mapreduce-4662.branch-1.patch
        0.7 kB
        Kihwal Lee

        Activity

        Thomas Graves created issue -
        Kihwal Lee made changes -
        Field Original Value New Value
        Assignee Kihwal Lee [ kihwal ]
        Kihwal Lee made changes -
        Attachment mapreduce-4662.branch-1.patch [ 12545957 ]
        Kihwal Lee made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Kihwal Lee made changes -
        Attachment mapreduce-4662.branch-1.patch [ 12545958 ]
        Thomas Graves made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 1.2.0 [ 12321661 ]
        Resolution Fixed [ 1 ]
        Matt Foley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Kihwal Lee
            Reporter:
            Thomas Graves
          • Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development