Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-744

Samza shutdown sequence throws exception

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0, 0.9.1
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      The current shutdown sequence has a problematic sequence for changelog attached stores:

          } finally {
            info("Shutting down.")
      
            shutdownConsumers
            shutdownTask
            shutdownProducers
            shutdownStores
            shutdownLocalityManager
            shutdownOffsetManager
            shutdownMetrics
      
            info("Shutdown complete.")
          }
      

      If the KV-stores has pending writes in cache and a changelog attached, shutdownStores will try to flush the store, which results in invoking producer.send(). However, the producers are already shutdown according to the above sequence. We need to move the shutdownProducers later than any shutdown procedure that would possibly flushing out pending writes to the system streams.

        Attachments

        1. SAMZA-744-0.patch
          37 kB
          Yi Pan
        2. SAMZA-744-1.patch
          36 kB
          Yi Pan

          Activity

            People

            • Assignee:
              nickpan47 Yi Pan
              Reporter:
              nickpan47 Yi Pan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: