Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24813

HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.2, 2.3.1
    • Fix Version/s: 2.2.3, 2.3.2, 2.4.0
    • Component/s: Tests
    • Labels:
      None

      Description

      HiveExternalCatalogVersionsSuite is still failing periodically with errors from mirror sites. In fact, the test depends on the Spark versions it needs being available on the mirrors, but older versions will eventually be removed.

      The test should fall back to downloading from archive.apache.org if mirrors don't have the Spark release, or aren't responding.

      This has become urgent as I helpfully already purged many old Spark releases from mirrors, as requested by the ASF, before realizing it would probably make this test fail deterministically.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                srowen Sean Owen
                Reporter:
                srowen Sean Owen
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: