Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3819

Jenkins should compile Spark against multiple versions of Hadoop

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Won't Fix
    • 1.1.0
    • 1.1.1
    • Build

    Description

      The build broke because of PR https://github.com/apache/spark/pull/2609#issuecomment-57962393 - however the build failure was not caught by Jenkins. From what I understand the build failure occurs when Spark is built manually against certain versions of Hadoop.

      It seems intuitive that Jenkins should catch this sort of thing. The code should be compiled against multiple Hadoop versions. It seems like overkill to run the full test suite against all Hadoop versions.

      Attachments

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned
            mcheah Matt Cheah
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment