Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14331

HadoopScheduledThreadPoolExecutor broken for periodic task running

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.8.0, 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: common
    • Labels:
      None
    • Target Version/s:

      Description

      The HadoopScheduledThreadPoolExecutor (introduced in HADOOP-12749) is broken for the scheduling of periodic tasks (i.e. for tasks submitted with scheduleAtFixedRate and scheduleAfterFixedDelay).

      The behavior of the executor with these methods is that the underlying task is executed once, and then blocks the running thread indefinitely in ExecutorHelper::logThrowableFromAfterExecute, meaning further executions of the task won't run, and will also block the running thread from running any other tasks.

      A quick scan of the source has shown me that these methods are used on HadoopScheduledThreadPoolExecutor instances in several places in the code base, at least in JobHistory and CleanerService, which appears to mean that these classes also no longer function correctly.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                gabriel.reid Gabriel Reid
                Reporter:
                gabriel.reid Gabriel Reid
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated: