[ZOOKEEPER-3170] Umbrella for eliminating ZooKeeper flaky tests

• Type: Test
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: tests
• Assignee: Andor Molnar
• Reporter: Andor Molnar
• Created: 15/Oct/18 10:17
• Updated: 16/Mar/21 06:47

Description

Umbrella ticket for joint community efforts to reduce number of flaky tests and improve the stability of our Jenkins builds.

Flaky test reports can be found at https://ci-hadoop.apache.org/view/ZooKeeper/job/ZooKeeper-Find-Flaky-Tests/lastSuccessfulBuild/artifact/report.html

Sub-Tasks

• Flaky test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff: Resolved
• Flaky test: org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged: Resolved
• startSingleServerTest may be flaky: Open
• Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalRun: Open
• Flaky NullPointerException while closing client connection: Resolved
• flaky test LearnerSnapshotThrottlerTest: Open
• flaky test testResyncByTxnlogThenDiffAfterFollowerCrashes: Resolved
• testLeaderElectionWithDisloyalVoter is flaky: Reopened
• Flaky Test: testNullQuorumAuthServerWithValidQuorumAuthPacket: Resolved
• testManyChildWatchersAutoReset is flaky: Closed
• Flaky Test: org.apache.zookeeper.test.SSLTest.testSecureQuorumServer: Closed
• Flaky test: testClientAuthAgainstNoAuthServerWithLowerSid: Resolved
• Track OutOfMemory failures on Flaky Dashboard: Open
• Flaky Test: testZeroWeightQuorum: Closed
• Flaky Tests: ReconfigTest fails on Solaris: Open
• Flaky Test: org.apache.zookeeper.test.QuorumTest.testMultipleWatcherObjs: Closed
• Flaky Test: org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest.testRollingUpgrade: Resolved
• Flaky Test: org.apache.zookeeper.test.NonRecoverableErrorTest.testZooKeeperServiceAvailableOnLeader: Resolved
• Flaky Test: org.apache.zookeeper.test.QuorumZxidSyncTest.testBehindLeader: Resolved
• Introduce ZooKeeper flaky test dashboard: Open
• Flaky Test: org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords: Closed
• Flaky Test: org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange: Resolved
• Flaky test:StaticHostProviderTest.testNextDoesNotSleepForZero: Closed
• Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalObserverRun: Closed
• Introduce a python script for generating flaky test report: Resolved
• Set up Apache Jenkins job that runs the flaky test analyzer script.: Resolved
• Flaky: org.apache.zookeeper.test.SaslAuthFailNotifyTest: Closed
• Flaky test: org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testInconsistentDueToNewLeaderOrder: Open
• Flaky test: org.apache.zookeeper.server.ZxidRolloverTest.testRolloverThenLeaderRestart: Open
• Flaky test: org.apache.zookeeper.test.ClientSSLTest.testClientServerSSL: Closed
• Flaky: multiple intermittent segfaults in C++ tests: Closed
• Run github pre-commit hook tests on 4 threads: Resolved
• Flaky test: LearnerMetricsTest.testLearnerMetricsTest(): Resolved
• Flaky test:CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor: Resolved
• Flaky test test:org.apache.zookeeper.test.DisconnectedWatcherTest.testManyChildWatchersAutoReset: Open
• Flaky test: org.apache.zookeeper.test.WatcherTest: Resolved
• Flaky test: RequestPathMetricsCollectorTest#testMultiThreadPerf: Open
• Flaky test: QuorumPeerMainTest#testLeaderOutOfView: Resolved
• Flaky test: RequestThrottlerTest: Closed