Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8325

Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.0.0-alpha
    • 0.23.3, 2.0.2-alpha
    • fs
    • None
    • Reviewed

    Description

      FileSystem adds a JVM shutdown hook when a filesystem instance is cached.

      MRAppMaster also uses a JVM shutdown hook, among other things, the MRAppMaster JVM shutdown hook is used to ensure state are written to HDFS.

      This creates a race condition because each JVM shutdown hook is a separate thread and if there are multiple JVM shutdown hooks there is not assurance of order of execution, they could even run in parallel.

      Attachments

        1. HADOOP-8325.patch
          17 kB
          Alejandro Abdelnur
        2. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        3. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        4. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        5. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        6. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        7. HADOOP-8325.patch
          15 kB
          Alejandro Abdelnur
        8. HADOOP-8325.patch
          10 kB
          Alejandro Abdelnur

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tucu00 Alejandro Abdelnur
            tucu00 Alejandro Abdelnur
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment