Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-8325

Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      FileSystem adds a JVM shutdown hook when a filesystem instance is cached.

      MRAppMaster also uses a JVM shutdown hook, among other things, the MRAppMaster JVM shutdown hook is used to ensure state are written to HDFS.

      This creates a race condition because each JVM shutdown hook is a separate thread and if there are multiple JVM shutdown hooks there is not assurance of order of execution, they could even run in parallel.

        Attachments

        1. HADOOP-8325.patch
          17 kB
          Alejandro Abdelnur
        2. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        3. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        4. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        5. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        6. HADOOP-8325.patch
          16 kB
          Alejandro Abdelnur
        7. HADOOP-8325.patch
          15 kB
          Alejandro Abdelnur
        8. HADOOP-8325.patch
          10 kB
          Alejandro Abdelnur

          Issue Links

            Activity

              People

              • Assignee:
                tucu00 Alejandro Abdelnur
                Reporter:
                tucu00 Alejandro Abdelnur
              • Votes:
                0 Vote for this issue
                Watchers:
                15 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: