Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-59

Support dropping messages on serde failures

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.8.0
    • container
    • None

    Description

      Samza uses the Serde interface to serialize and deserialize messages when producing and sending them.

      Right now, if a Serde is unable to (de)serialize a message, it has no choice but to throw an exception, or put some non-standard surrogate object in the message envelope's key/value fields. If an exception is throws, the whole container fails.

      We should make it possible for Serdes to signal to Samza that they were unable to (de)serialize the message in question, and add configuration to Samza to be able to drop these messages rather than throwing an exception.

      Attachments

        1. SAMZA-59.1.patch
          18 kB
          Yan Fang
        2. SAMZA-59.patch
          9 kB
          Yan Fang

        Activity

          People

            closeuris Yan Fang
            criccomini Chris Riccomini
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: