Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-72

Instance-based Encoder/Decoder interface

    XMLWordPrintableJSON

Details

    Description

      In our current implementation of SparkCoder, spark Serializer instance is instantiated for every encode & decode call.
      I've noticed that this introduce significant performance degradation.
      Therefore, we need to modify the interface of Coder from static fashion to instance-based fashion.

      Also, we have some use cases to separate the encoding and decoding like in #32.
      Because of this, we need to separate the Coder interface to Encoder and Decoder.
      Also, it would be good to make them as execution properties.

      Attachments

        Issue Links

          Activity

            People

              sanha Sanha Lee
              sanha Sanha Lee
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: