Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21575

Eliminate needless synchronization in java-R serialization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.3.0
    • Component/s: SparkR
    • Labels:
      None

      Description

      As long as org.apache.spark.api.r.JVMObjectTracker is backed by ConcurrentHashMap, synchronized blocks in get(..) and remove(..) methods can be safely removed.

      This would eliminate lock contention in org.apache.spark.api.r.SerDe
      and org.apache.spark.api.r.RBackendHandler.

        Attachments

          Activity

            People

            • Assignee:
              sereneant Iurii Antykhovych
              Reporter:
              sereneant Iurii Antykhovych
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: