Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-59

Support dropping messages on serde failures

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.8.0
    • Component/s: container
    • Labels:
      None

      Description

      Samza uses the Serde interface to serialize and deserialize messages when producing and sending them.

      Right now, if a Serde is unable to (de)serialize a message, it has no choice but to throw an exception, or put some non-standard surrogate object in the message envelope's key/value fields. If an exception is throws, the whole container fails.

      We should make it possible for Serdes to signal to Samza that they were unable to (de)serialize the message in question, and add configuration to Samza to be able to drop these messages rather than throwing an exception.

        Attachments

        1. SAMZA-59.patch
          9 kB
          Yan Fang
        2. SAMZA-59.1.patch
          18 kB
          Yan Fang

          Activity

            People

            • Assignee:
              closeuris Yan Fang
              Reporter:
              criccomini Chris Riccomini
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: