Hadoop Common
  1. Hadoop Common
  2. HADOOP-8325

Add a ShutdownHookManager to be used by different components instead of the JVM shutdownhook

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: 0.23.3, 2.0.2-alpha
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      FileSystem adds a JVM shutdown hook when a filesystem instance is cached.

      MRAppMaster also uses a JVM shutdown hook, among other things, the MRAppMaster JVM shutdown hook is used to ensure state are written to HDFS.

      This creates a race condition because each JVM shutdown hook is a separate thread and if there are multiple JVM shutdown hooks there is not assurance of order of execution, they could even run in parallel.

      1. HADOOP-8325.patch
        17 kB
        Alejandro Abdelnur
      2. HADOOP-8325.patch
        16 kB
        Alejandro Abdelnur
      3. HADOOP-8325.patch
        16 kB
        Alejandro Abdelnur
      4. HADOOP-8325.patch
        16 kB
        Alejandro Abdelnur
      5. HADOOP-8325.patch
        16 kB
        Alejandro Abdelnur
      6. HADOOP-8325.patch
        16 kB
        Alejandro Abdelnur
      7. HADOOP-8325.patch
        15 kB
        Alejandro Abdelnur
      8. HADOOP-8325.patch
        10 kB
        Alejandro Abdelnur

        Issue Links

          Activity

            People

            • Assignee:
              Alejandro Abdelnur
              Reporter:
              Alejandro Abdelnur
            • Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development