Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26264

It is better to add @transient to field 'locs' for class `ResultTask`.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Not A Problem
    • 3.0.0
    • None
    • Spark Core
    • None

    Description

      The field 'locs' is only used in driver side  for class `ResultTask`, so it is not needed to serialize  when sending the `ResultTask`  to executor.

      Although it's not very big, it's very frequent, so we can add` transient` for it  like `ShuffleMapTask`

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            10110346 liuxian
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: