Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
Description
In our current implementation of SparkCoder, spark Serializer instance is instantiated for every encode & decode call.
I've noticed that this introduce significant performance degradation.
Therefore, we need to modify the interface of Coder from static fashion to instance-based fashion.
Also, we have some use cases to separate the encoding and decoding like in #32.
Because of this, we need to separate the Coder interface to Encoder and Decoder.
Also, it would be good to make them as execution properties.