Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24139

Fix Flaky Tests

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.4.0
    • None
    • Tests

    Description

      As of today, master and branch-2.3 branches suffer from several flaky tests.
      This umbrella issue aims to give better visibility for the recent flaky tests.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25692 Remove static initialization of worker eventLoop handling chunk fetch requests within TransportContext

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23390 Flaky test: FileBasedDataSourceSuite

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24152 SparkR CRAN feasibility check server problem

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-26152 Synchronize Worker Cleanup with Worker Shutdown

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23415 BufferHolderSparkSubmitSuite is flaky

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23458 Flaky test: OrcQuerySuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23489 Flaky Test: HiveExternalCatalogVersionsSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23504 Flaky test: RateSourceV2Suite.basic microbatch execution

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23505 Flaky test: ParquetQuerySuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23606 Flakey FileBasedDataSourceSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23622 Flaky Test: HiveClientSuites

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23775 Flaky test: DataFrameRangeSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24140 Flaky test: KMeansClusterSuite.task size should be small in both training and prediction

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24153 Flaky Test: DirectKafkaStreamSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24173 Flaky Test: VersionsSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24211 Flaky test: StreamingOuterJoinSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24239 Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24285 Flaky test: ContinuousSuite.query without test harness

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24318 Flaky test: SortShuffleSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25542 Flaky test: OpenHashMapSuite

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25792 Flaky test: BarrierStageOnSubmittedSuite."submit a barrier ResultStage that requires more slots than current total under local-cluster mode"

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25812 Flaky test: PagedTableSuite.pageNavigation

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-19613 Flaky test: StateStoreRDDSuite

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-19989 Flaky Test: org.apache.spark.sql.kafka010.KafkaSourceStressSuite

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-23416 Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24123 Fix a flaky test `DateTimeUtilsSuite.monthsBetween`

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25726 Flaky test: SaveIntoDataSourceCommandSuite.`simpleString is redacted`

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-23894 Flaky Test: BucketedWriteWithoutHiveSupportSuite

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • In Progress

          Test - A new unit, integration or system test. SPARK-23197 Flaky test: spark.streaming.ReceiverSuite."receiver_life_cycle"

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              dongjoon Dongjoon Hyun
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: