Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-29378

Upgrade SparkR to use Arrow 0.15 API

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • SparkR
    • None

    Description

      AppVeyor tests seem failing with Arrow 0.15 - https://github.com/apache/spark/pull/26041
      We should set ARROW_PRE_0_15_IPC_FORMAT to 1.

      Attachments

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-31701 Bump up the minimum Arrow version as 0.15.1 in SparkR

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Test - A new unit, integration or system test. SPARK-29403 Uses Arrow R 0.14.1 in AppVeyor for now

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-29376 Upgrade Apache Arrow to 0.15.1

          • Major - Major loss of function.
          • Resolved

          Documentation - Documentation or Website SPARK-29367 pandas udf not working with latest pyarrow release (0.15.0)

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #26555

          Web Link GitHub Pull Request #26566

          Activity

            People

              dongjoon Dongjoon Hyun
              gurwls223 Hyukjin Kwon
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: