Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23874

Upgrade apache/arrow to 0.10.0

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersStop watchingWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • PySpark
    • None

    Description

      Version 0.10.0 will allow for the following improvements and bug fixes:

      • Allow for adding BinaryType support ARROW-2141
      • Bug fix related to array serialization ARROW-1973
      • Python2 str will be made into an Arrow string instead of bytes ARROW-2101
      • Python bytearrays are supported in as input to pyarrow ARROW-2141
      • Java has common interface for reset to cleanup complex vectors in Spark ArrowWriter ARROW-1962
      • Cleanup pyarrow type equality checks ARROW-2423
      • ArrowStreamWriter should not hold references to ArrowBlocks ARROW-2632, ARROW-2645
      • Improved low level handling of messages for RecordBatch ARROW-2704

       

       

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bryanc Bryan Cutler Assign to me
            smilegator Xiao Li
            Votes:
            0 Vote for this issue
            Watchers:
            9 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment