Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-12260

Graceful Shutdown with In-Memory State

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: DStreams
    • Labels:

      Description

      Users often stop and restart their streaming jobs for tasks such as maintenance, software upgrades or even application logic updates. When a job re-starts it should pick up where it left off i.e. any state information that existed when the job stopped should be used as the initial state when the job restarts.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              mwws Mao, Wei
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: