Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11799

Make it explicit in executor logs that uncaught exceptions are thrown during executor shutdown

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.5.1
    • Fix Version/s: 1.6.0
    • Component/s: Spark Core
    • Labels:
      None
    • Target Version/s:

      Description

      Here is some background for the issue.

      Customer got OOM exception in one of the task and executor got killed with kill %p. Few shutdown hooks are registered with ShutDownHookManager to do the hadoop temp directory cleanup. During this shutdown phase other tasks are throwing uncaught exception and executor logs are filled up with so many of them.

      Since it is unclear for the customer in driver logs/ Spark UI why the container was lost customer is going through the executor logs and he see lot of uncaught exception.

      It would be clear to the customer if we can prepend the uncaught exceptions with some message like [Container is in shutdown mode] so that he can skip those.

        Attachments

          Activity

            People

            • Assignee:
              vsr Srinivasa Reddy Vundela
              Reporter:
              vsr Srinivasa Reddy Vundela
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: