Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-206

Efficient Broadcast Variable Serialization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Labels:

      Description

      For simplicity we are assuming broadcast variables to be Java 'Serializable'. To handle large broadcast variables efficiently, we should instead use more efficient serializers such as Kryo(as in Spark).

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              johnyangk John Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: