Uploaded image for project: 'ZooKeeper'
  1. ZooKeeper
  2. ZOOKEEPER-3170

Umbrella for eliminating ZooKeeper flaky tests

    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: tests
    • Labels:
      None

      Description

      Umbrella ticket for joint community efforts to reduce number of flaky tests and improve the stability of our Jenkins builds.

      Flaky test reports can be found at https://ci-hadoop.apache.org/view/ZooKeeper/job/ZooKeeper-Find-Flaky-Tests/lastSuccessfulBuild/artifact/report.html

        Attachments

        1.
        Flaky test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalFollowerRunWithDiff Sub-task Open Unassigned  
        2.
        Flaky test: org.apache.zookeeper.test.WatchEventWhenAutoResetTest.testNodeDataChanged Sub-task Resolved Andor Molnar

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 5.5h
        3.
        startSingleServerTest may be flaky Sub-task Open Bogdan Kanivets  
        4.
        Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalRun Sub-task Open Unassigned  
        5.
        Flaky NullPointerException while closing client connection Sub-task Resolved Unassigned  
        6.
        flaky test LearnerSnapshotThrottlerTest Sub-task Open Unassigned  
        7.
        flaky test testResyncByTxnlogThenDiffAfterFollowerCrashes Sub-task Resolved Andor Molnar  
        8.
        testLeaderElectionWithDisloyalVoter is flaky Sub-task Reopened Unassigned  
        9.
        Flaky Test: testNullQuorumAuthServerWithValidQuorumAuthPacket Sub-task Resolved Andor Molnar  
        10.
        testManyChildWatchersAutoReset is flaky Sub-task Closed Bogdan Kanivets

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 3h 40m
        11.
        Flaky Test: org.apache.zookeeper.test.SSLTest.testSecureQuorumServer Sub-task Closed Andor Molnar  
        12.
        Flaky test: testClientAuthAgainstNoAuthServerWithLowerSid Sub-task Resolved Andor Molnar

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 10m
        13.
        Track OutOfMemory failures on Flaky Dashboard Sub-task Open Bogdan Kanivets  
        14.
        Flaky Test: testZeroWeightQuorum Sub-task Closed Andor Molnar  
        15.
        Flaky Tests: ReconfigTest fails on Solaris Sub-task Open Unassigned  
        16.
        Flaky Test: org.apache.zookeeper.test.QuorumTest.testMultipleWatcherObjs Sub-task Closed Andor Molnar  
        17.
        Flaky Test: org.apache.zookeeper.server.quorum.auth.QuorumAuthUpgradeTest.testRollingUpgrade Sub-task Resolved Andor Molnar  
        18.
        Flaky Test: org.apache.zookeeper.test.NonRecoverableErrorTest.testZooKeeperServiceAvailableOnLeader Sub-task Resolved Andor Molnar  
        19.
        Flaky Test: org.apache.zookeeper.test.QuorumZxidSyncTest.testBehindLeader Sub-task Resolved Andor Molnar  
        20.
        Introduce ZooKeeper flaky test dashboard Sub-task Open Michael Han  
        21.
        Flaky Test: org.apache.zookeeper.test.FourLetterWordsTest.testFourLetterWords Sub-task Closed Andor Molnar  
        22.
        Flaky Test: org.apache.zookeeper.test.ReconfigTest.testQuorumSystemChange Sub-task Resolved Andor Molnar  
        23.
        Flaky test:StaticHostProviderTest.testNextDoesNotSleepForZero Sub-task Closed Andor Molnar  
        24.
        Flaky Test: org.apache.zookeeper.server.quorum.Zab1_0Test.testNormalObserverRun Sub-task Closed Andor Molnar  
        25.
        Introduce a python script for generating flaky test report Sub-task Resolved Michael Han  
        26.
        Set up Apache Jenkins job that runs the flaky test analyzer script. Sub-task Resolved Michael Han  
        27.
        Flaky: org.apache.zookeeper.test.SaslAuthFailNotifyTest Sub-task Closed Andor Molnar

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        28.
        Flaky test: org.apache.zookeeper.server.quorum.QuorumPeerMainTest.testInconsistentDueToNewLeaderOrder Sub-task Open Unassigned  
        29.
        Flaky test: org.apache.zookeeper.server.ZxidRolloverTest.testRolloverThenLeaderRestart Sub-task Open Unassigned  
        30.
        Flaky test: org.apache.zookeeper.test.ClientSSLTest.testClientServerSSL Sub-task Closed Michael K. Edwards

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        31.
        Flaky: multiple intermittent segfaults in C++ tests Sub-task Closed Andor Molnar

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 50m
        32.
        Run github pre-commit hook tests on 4 threads Sub-task Resolved Andor Molnar

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        33.
        Flaky test: LearnerMetricsTest.testLearnerMetricsTest() Sub-task Resolved Mate Szalay-Beko

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 3h 50m
        34.
        Flaky test:CommitProcessorMetricsTest.testConcurrentRequestProcessingInCommitProcessor Sub-task Resolved Unassigned  
        35.
        Flaky test test:org.apache.zookeeper.test.DisconnectedWatcherTest.testManyChildWatchersAutoReset Sub-task Open Unassigned

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 0.5h
        36.
        Flaky test: org.apache.zookeeper.test.WatcherTest Sub-task Resolved Mohammad Arshad

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h
        37.
        Flaky test: RequestPathMetricsCollectorTest#testMultiThreadPerf Sub-task Open Unassigned  
        38.
        Flaky test: QuorumPeerMainTest#testLeaderOutOfView Sub-task Resolved Mohammad Arshad

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 50m
        39.
        Flaky test: RequestThrottlerTest Sub-task Open Damien Diederen

        100%

        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 1h 10m

          Activity

            People

            • Assignee:
              andor Andor Molnar
              Reporter:
              andor Andor Molnar
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 20.5h
                20.5h