Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-390 High-Level Language for Samza
  3. SAMZA-484

Define the serialization/deserialization format for stream tuple

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 0.9.0
    • None
    • sql

    Description

      It came out in the discussion for streaming SQL that we will need to define the serialization/deserialization format for stream tuple.

      The ideal serialization/deserialization format should allow both forward and backward compatibility on additional/missing fields in the data.

      Several choices to be considered:
      1) Avro
      2) Protobuf
      3) Flatbuffer

      It might also be interesting to consider a pluggable serialization interface that allows different serialization methods for different Samza jobs.

      Attachments

        1. SAMZA-484.patch
          132 kB
          Navina Ramesh
        2. SAMZA-484-1.patch
          131 kB
          Navina Ramesh
        3. SAMZA-484-2.patch
          131 kB
          Navina Ramesh
        4. SAMZA-484-3.patch
          30 kB
          Navina Ramesh
        5. SAMZA-484-4.patch
          37 kB
          Navina Ramesh
        6. SAMZA-484-5.patch
          38 kB
          Navina Ramesh
        7. SAMZA-484-6.patch
          2 kB
          Chris Riccomini

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SAMZA-429 Decouple Protocol from Task

          • Major - Major loss of function.
          • Open

          Activity

            People

              navina Navina Ramesh
              nickpan47 Yi Pan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: