Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-390 High-Level Language for Samza
  3. SAMZA-484

Define the serialization/deserialization format for stream tuple

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: None
    • Component/s: sql
    • Labels:

      Description

      It came out in the discussion for streaming SQL that we will need to define the serialization/deserialization format for stream tuple.

      The ideal serialization/deserialization format should allow both forward and backward compatibility on additional/missing fields in the data.

      Several choices to be considered:
      1) Avro
      2) Protobuf
      3) Flatbuffer

      It might also be interesting to consider a pluggable serialization interface that allows different serialization methods for different Samza jobs.

        Attachments

        1. SAMZA-484.patch
          132 kB
          Navina Ramesh
        2. SAMZA-484-1.patch
          131 kB
          Navina Ramesh
        3. SAMZA-484-2.patch
          131 kB
          Navina Ramesh
        4. SAMZA-484-3.patch
          30 kB
          Navina Ramesh
        5. SAMZA-484-4.patch
          37 kB
          Navina Ramesh
        6. SAMZA-484-5.patch
          38 kB
          Navina Ramesh
        7. SAMZA-484-6.patch
          2 kB
          Chris Riccomini

          Issue Links

            Activity

              People

              • Assignee:
                navina Navina Ramesh
                Reporter:
                nickpan47 Yi Pan
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: