Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24813

HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.2.2, 2.3.1
    • 2.2.3, 2.3.2, 2.4.0
    • Tests
    • None

    Description

      HiveExternalCatalogVersionsSuite is still failing periodically with errors from mirror sites. In fact, the test depends on the Spark versions it needs being available on the mirrors, but older versions will eventually be removed.

      The test should fall back to downloading from archive.apache.org if mirrors don't have the Spark release, or aren't responding.

      This has become urgent as I helpfully already purged many old Spark releases from mirrors, as requested by the ASF, before realizing it would probably make this test fail deterministically.

      Attachments

        Issue Links

          Activity

            People

              srowen Sean R. Owen
              srowen Sean R. Owen
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: