Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-422

TaskTracker directoryCleanupThread never gets terminated

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      When a task tracker starts its work it calls startCleanupThreads() to create a directoryCleanupThread.

      only, that thread is never terminated; it runs for the life of the process.

      It should be terminated when the TaskTracker itself is terminated, presumably after it has done the last cleanup.

        Activity

        Steve Loughran created issue -
        Hide
        Steve Loughran added a comment -

        Same for taskCleanupThread

        Show
        Steve Loughran added a comment - Same for taskCleanupThread
        Hide
        Steve Loughran added a comment -

        One aspect of the taskCleanupThread is that it holds an implicit reference to the TaskThread, so until the TaskCleanupThread is terminated, the TaskTracker and its memory will be retained.

        Show
        Steve Loughran added a comment - One aspect of the taskCleanupThread is that it holds an implicit reference to the TaskThread, so until the TaskCleanupThread is terminated, the TaskTracker and its memory will be retained.
        Owen O'Malley made changes -
        Field Original Value New Value
        Project Hadoop Common [ 12310240 ] Hadoop Map/Reduce [ 12310941 ]
        Key HADOOP-3727 MAPREDUCE-422
        Affects Version/s 0.19.0 [ 12313211 ]
        Component/s mapred [ 12310690 ]
        Gavin made changes -
        Reporter Steve Loughran [ steve_l ] Steve Loughran [ stevel@apache.org ]
        Hide
        Allen Wittenauer added a comment -

        Probably stale. closing.

        Show
        Allen Wittenauer added a comment - Probably stale. closing.
        Allen Wittenauer made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        2203d 1h 48m 1 Allen Wittenauer 21/Jul/14 17:26

          People

          • Assignee:
            Unassigned
            Reporter:
            Steve Loughran
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development