Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33146

Encountering an invalid rolling event log folder prevents loading other applications in SHS

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.1
    • Fix Version/s: 3.0.2, 3.1.0
    • Component/s: Spark Core
    • Labels:
      None

      Description

      A follow-on issue from https://issues.apache.org/jira/browse/SPARK-33133

      If an invalid rolling event log folder is encountered by the Spark History Server upon startup, it crashes the whole loading process and prevents any valid applications from loading. We should simply catch the error, log it, and continue loading other applications.

        Attachments

          Activity

            People

            • Assignee:
              Kimahriman Adam Binford
              Reporter:
              Kimahriman Adam Binford
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: