Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4921

Kill running jobs on InterruptedException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.17.0, 0.16.1
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Shutdown hook kills running jobs, but when running in Oozie launcher sometimes NodeManager can issue a SIGKILL after AM unregisters and before shutdown hook gets to execute causing orphaned jobs that continue to run. So it is better to kill when we see the InterruptedException.

      Added additional System.err logging to code in shutdown hooks as LogManager.shutdown() is called by mapreduce AM (Oozie launcher job is mapreduce) and log4j logging does not appear anymore.

        Attachments

        1. PIG-4921-3.patch
          15 kB
          Rohini Palaniswamy
        2. PIG-4921-2.patch
          10 kB
          Rohini Palaniswamy
        3. PIG-4921-1.patch
          9 kB
          Rohini Palaniswamy

          Issue Links

            Activity

              People

              • Assignee:
                rohini Rohini Palaniswamy
                Reporter:
                rohini Rohini Palaniswamy
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: