Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4921

Kill running jobs on InterruptedException

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.17.0, 0.16.1
    • None
    • None
    • Reviewed

    Description

      Shutdown hook kills running jobs, but when running in Oozie launcher sometimes NodeManager can issue a SIGKILL after AM unregisters and before shutdown hook gets to execute causing orphaned jobs that continue to run. So it is better to kill when we see the InterruptedException.

      Added additional System.err logging to code in shutdown hooks as LogManager.shutdown() is called by mapreduce AM (Oozie launcher job is mapreduce) and log4j logging does not appear anymore.

      Attachments

        1. PIG-4921-1.patch
          9 kB
          Rohini Palaniswamy
        2. PIG-4921-2.patch
          10 kB
          Rohini Palaniswamy
        3. PIG-4921-3.patch
          15 kB
          Rohini Palaniswamy

        Issue Links

          is broken by

          Bug - A problem which impairs or prevents the functions of the product. PIG-3524 Clean up Launcher and MapReduceLauncher after PIG-3419

          • Major - Major loss of function.
          • Closed
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. PIG-4928 MRExecutionEngine gets initialized even with Tez

          • Major - Major loss of function.
          • Open

          Activity

            People

              rohini Rohini Palaniswamy
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: