Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14331

HadoopScheduledThreadPoolExecutor broken for periodic task running

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.8.0, 3.0.0-alpha1
    • None
    • common
    • None

    Description

      The HadoopScheduledThreadPoolExecutor (introduced in HADOOP-12749) is broken for the scheduling of periodic tasks (i.e. for tasks submitted with scheduleAtFixedRate and scheduleAfterFixedDelay).

      The behavior of the executor with these methods is that the underlying task is executed once, and then blocks the running thread indefinitely in ExecutorHelper::logThrowableFromAfterExecute, meaning further executions of the task won't run, and will also block the running thread from running any other tasks.

      A quick scan of the source has shown me that these methods are used on HadoopScheduledThreadPoolExecutor instances in several places in the code base, at least in JobHistory and CleanerService, which appears to mean that these classes also no longer function correctly.

      Attachments

        Issue Links

          Activity

            People

              gabriel.reid Gabriel Reid
              gabriel.reid Gabriel Reid
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated: