Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6916

History server scheduling tasks at fixed rate can be problematic when those tasks are slow

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.7.4
    • Fix Version/s: None
    • Component/s: jobhistoryserver
    • Labels:
      None

      Description

      The job history server currently schedules both the task of moving jobs from intermediate to done and the task of cleaning jobs at a fixed rate. If those tasks take longer than the rate period to execute then a backlog of to-be-scheduled tasks can build up and cause a long storm of them to execute later when the blockage clears.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jlowe Jason Darrell Lowe
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: