Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1302

Improve Zookeeper error handling

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.1
    • Component/s: None
    • Labels:
      None

      Description

      In samza standalone, Zookeeper is used for accomplishing the following.

      A) For storing and retrieving the job model.
      B) Leader election amongst available stream processors.
      C) Propagating job model expiry to stream processors.
      D) Barrier for job model version upgrade.

      ZooKeeper Exceptions from all of the above scenarios are not propagated back to LocalApplicationRunner.waitForFinish.

      Incase of exception, an application will wait indefinitely if it is not bubbled up correctly.

      Potentially could cause stalled processors and duplicate stream processors.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                spvenkat Shanthoosh Venkataraman
                Reporter:
                spvenkat Shanthoosh Venkataraman
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: