Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2581

Oozie should reset SecurityManager in finally block

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 4.3.0
    • None
    • None

    Description

      jlowe found lot of lingering oozie launcher AMs which hung around 10 mins after successful completion and then jvm killed due to timeout. This happens when user code launches non-daemon threads, but mapreduce code does a System.exit() to avoid this from happening. Oozie does need the LauncherSecurityManager to capture exit codes when user applications do System.exit() . But it should reset it back to the originial security manager in the finally block so that AM code can proceed as expected in uber mode.

      2016-05-12 12:26:48,514 INFO [Thread-107] org.apache.hadoop.util.ExitUtil: Exiting with status 1
      2016-05-12  12:26:48,514 ERROR [Thread-107]  org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread  Thread[Thread-107,5,main] threw an Exception.
      java.lang.SecurityException: Intercepted System.exit(1)
              at org.apache.oozie.action.hadoop.LauncherSecurityManager.checkExit(LauncherMapper.java:637)
              at java.lang.Runtime.exit(Runtime.java:107)
              at java.lang.System.exit(System.java:971)
             at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:133)
              at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:170)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.exitMRAppMaster(MRAppMaster.java:655)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:636)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:676)
      

      Attachments

        1. OOZIE-2581-1.patch
          3 kB
          Satish Saley
        2. OOZIE-2581-2.patch
          3 kB
          Satish Saley
        3. OOZIE-2581-3.patch
          3 kB
          Satish Saley
        4. OOZIE-2581-4.patch
          3 kB
          Satish Saley

        Activity

          People

            satishsaley Satish Saley
            satishsaley Satish Saley
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: