Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2581

Oozie should reset SecurityManager in finally block

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.3.0
    • Component/s: None
    • Labels:
      None

      Description

      Jason Darrell Lowe found lot of lingering oozie launcher AMs which hung around 10 mins after successful completion and then jvm killed due to timeout. This happens when user code launches non-daemon threads, but mapreduce code does a System.exit() to avoid this from happening. Oozie does need the LauncherSecurityManager to capture exit codes when user applications do System.exit() . But it should reset it back to the originial security manager in the finally block so that AM code can proceed as expected in uber mode.

      2016-05-12 12:26:48,514 INFO [Thread-107] org.apache.hadoop.util.ExitUtil: Exiting with status 1
      2016-05-12  12:26:48,514 ERROR [Thread-107]  org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread  Thread[Thread-107,5,main] threw an Exception.
      java.lang.SecurityException: Intercepted System.exit(1)
              at org.apache.oozie.action.hadoop.LauncherSecurityManager.checkExit(LauncherMapper.java:637)
              at java.lang.Runtime.exit(Runtime.java:107)
              at java.lang.System.exit(System.java:971)
             at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:133)
              at org.apache.hadoop.util.ExitUtil.terminate(ExitUtil.java:170)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.exitMRAppMaster(MRAppMaster.java:655)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster.shutDownJob(MRAppMaster.java:636)
              at org.apache.hadoop.mapreduce.v2.app.MRAppMaster$JobFinishEventHandler$1.run(MRAppMaster.java:676)
      

        Attachments

        1. OOZIE-2581-1.patch
          3 kB
          Satish Saley
        2. OOZIE-2581-2.patch
          3 kB
          Satish Saley
        3. OOZIE-2581-3.patch
          3 kB
          Satish Saley
        4. OOZIE-2581-4.patch
          3 kB
          Satish Saley

          Activity

            People

            • Assignee:
              satishsaley Satish Saley
              Reporter:
              satishsaley Satish Saley
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: