Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19489

Stable serialization format for external & native code integration

          Details

          • Type: New Feature
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 2.2.0
          • Fix Version/s: None
          • Component/s: Spark Core, SQL
          • Labels:
            None
          • Target Version/s:

            Description

            As a Spark user, I want access to a (semi) stable serialization format that is high performance so I can integrate Spark with my application written in native code (C, C++, Rust, etc).

              Attachments

                Issue Links

                is related to

                Sub-task - The sub-task of the issue SPARK-13534 Implement Apache Arrow serializer for Spark DataFrame for use in DataFrame.toPandas

                • Major - Major loss of function.
                • Resolved

                  Activity

                    People

                    • Assignee:
                      Unassigned
                      Reporter:
                      rxin Reynold Xin
                    • Votes:
                      6 Vote for this issue
                      Watchers:
                      40 Start watching this issue

                      Dates

                      • Created:
                        Updated: