Uploaded image for project: 'Apache Nemo'
  1. Apache Nemo
  2. NEMO-33

Support Apache Arrow

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Apache arrow is a cross-language development platform for in-memory data. Having a common data layer might help Nemo to prevent copying and converting different data formats (serializing and deserializing)

      Some references: https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-13534 , https://databricks.com/session/improving-python-and-spark-performance-and-interoperability-with-apache-arrow

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            wonook Wonook
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:

              Slack

                Issue deployment