Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-10457

[CI] Fix Spark branch-3.0 integration tests

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      The Spark branch-3.0 is currently failing because this branch has not been updated or patched to use the latest Arrow Java, see https://github.com/ursa-labs/crossbow/actions?query=branch:actions-681-github-test-conda-python-3.7-spark-branch-3.0. The Spark branch-3.0 has already been released and only able to get bug fixes. Instead of patching the Spark build, we should not try to rebuild Spark with the latest Arrow Java, and instead only test against the latest pyarrow. This should work, but might also need a minor Python patch.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            bryanc Bryan Cutler
            bryanc Bryan Cutler
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 9h
                9h

                Slack

                  Issue deployment