Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3148

Support configured serializers for shipping UDFs

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Java 8 lambdas are very useful for expressing flow logic. However, their closures need to be serialized to nodes in the cluster. Current implementation only uses Java Serialization, which is limiting when integrating code from other projects. I propose reusing flink's existing serialization mechanisms (POJO magic, Kryo, extensible, &c) for serializing UDF instances as well.

      Discussion: http://mail-archives.apache.org/mod_mbox/flink-user/201512.mbox/%3CCANZa%3DGuchEr60r4bFWARtepQ37ZivSUQn6A1-o2eT66_M%3DFW%2BA%40mail.gmail.com%3E

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                ndimiduk Nick Dimiduk
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: