Uploaded image for project: 'CXF'
  1. CXF
  2. CXF-8393

Umbrella issue to address fixing flaky tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • Unknown

    Description

      There are a number of tests which are flaky and fail the builds from time to time. We should address those by fixing or at last, removing them altogether.

      Adding test retry to the offending modules (https://maven.apache.org/surefire/maven-surefire-plugin/examples/rerun-failing-tests.html) should help.

      [INFO] Results:
[INFO] 
[WARNING] Flakes: 
[WARNING] org.apache.cxf.transport.jms.RequestResponseTest.testRequestQueueResponseTempQueue
[ERROR]   Run 1: RequestResponseTest.testRequestQueueResponseTempQueue:41->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306 Can't receive the Conduit Message in 10 seconds
[INFO]   Run 2: PASS
[INFO] 
[WARNING] org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue
[ERROR]   Run 1: RequestResponseTest.testRequestTopicResponseStaticQueue:64->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306 Can't receive the Conduit Message in 10 seconds
[ERROR]   Run 2: RequestResponseTest.testRequestTopicResponseStaticQueue:63->sendAndReceiveMessages:95->AbstractJMSTester.sendMessage:165->AbstractJMSTester.sendoutMessage:187 » Runtime Timeout receiving message with correlationId eb382e0774ca4c4f9f5bae1ae4dd147d0000000000000001
[INFO]   Run 3: PASS
[INFO] 
[INFO] 
[WARNING] Tests run: 65, Failures: 0, Errors: 0, Skipped: 1, Flakes: 2

      While the retrying does not fix the flaky tests, it should help reduce the number of builds that fail. The end goal is to fix the flaky tests.

      Attachments

        1.
        		 Fix org.apache.cxf.systest.jaxrs.JAXRSContinuationsServlet3Test.testCancelVoidOnResumedTest Sub-task Closed Andriy Redko
        2.
        		 Fix org.apache.cxf.workqueue.AutomaticWorkQueueTest.testEnqueueImmediate Sub-task Closed Andriy Redko
        3.
        		 Fix org.apache.cxf.systest.ws.rm.ProtocolVariationsTest.testRM10WSA200408Decoupled Sub-task Open Andriy Redko
        4.
        		 Fix org.apache.cxf.systest.ws.rm.SequenceTest.testOnewayAnonymousAcksSuppressedAsyncExecutor Sub-task Open Andriy Redko
        5.
        		 Fix org.apache.cxf.systest.ws.rm.DeliveryAssuranceOnewayTest.testInOrderAsyncExecutor Sub-task Open Andriy Redko
        6.
        		 Fix org.apache.cxf.transport.jms.uri.URIConfiguredConduitTest.testSendReceive Sub-task Open Andriy Redko
        7.
        		 Fix org.apache.cxf.systest.ws.rm.ManagedEndpointsTest.testManagedEndpointsOneway Sub-task Closed Andriy Redko
        8.
        		 Fix org.apache.cxf.transport.jms.util.MessageListenerTest.testNoTransaction Sub-task Closed Andriy Redko
        9.
        		 Fix org.apache.cxf.systest.ws.rm.ManagedEndpointsTest.testManagedEndpointsOneway12 Sub-task Closed Andriy Redko
        10.
        		 Fix org.apache.cxf.jaxrs.sse.client.SseEventSourceImplTest.testReconnectAndTwoEventsReceived Sub-task Closed Andriy Redko
        11.
        		 Fix org.apache.cxf.systest.ws.rm.DeliveryAssuranceOnewayTest.testExactlyOnceInOrder Sub-task Open Andriy Redko
        12.
        		 Fix org.apache.cxf.systest.jms.tx.JMSTransactionTest.testTransactionOneWay Sub-task Closed Andriy Redko
        13.
        		 Fix org.apache.cxf.jaxrs.client.logging.RESTLoggingTest.testBinary Sub-task Closed Andriy Redko
        14.
        		 Fix org.apache.cxf.systest.ws.rm.ProtocolVariationsTest.testDefaultDecoupled Sub-task Open Andriy Redko
        15.
        		 Fix org.apache.cxf.systest.jaxrs.spring.boot.SpringJaxrsTest.testJaxrsSuccessMetric Sub-task Closed Andriy Redko
        16.
        		 Fix org.apache.cxf.jaxrs.client.logging.RESTLoggingTest.testSlf4 Sub-task Closed Andriy Redko
        17.
        		 Fix org.apache.cxf.systest.jaxrs.JAXRSContinuationsServlet3Test.testSuspendSetTimeout Sub-task Closed Andriy Redko
        18.
        		 Fix org.apache.cxf.systest.ws.addressing.MAPTest.testImplicitMAPs Sub-task Open Andriy Redko
        19.
        		 Fix org.apache.cxf.osgi.itests.jaxrs.JaxRsServiceTest Sub-task Closed Andriy Redko
        20.
        		 Fix org.apache.cxf.transport.jms.util.MessageListenerTest.testWithJTA Sub-task Closed Andriy Redko
        21.
        		 Fix org.apache.cxf.systest.jaxrs.failover.FailoverTest.testSequentialStrategyWithDiffBaseAddresses Sub-task Open Andriy Redko
        22.
        		 Fix org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseTempQueue Sub-task Open Andriy Redko
        23.
        		 Fix org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue Sub-task Reopened Andriy Redko
        24.
        		 Fix org.apache.cxf.transport.http.asyncclient.hc5.AsyncHTTPConduitTest.testResponseSameBufferSize Sub-task Closed Andriy Redko
        25.
        		 Fix org.apache.cxf.transport.http.netty.client.NettyHttpConduitTest.testCallAsyncCallbackInvokedOnlyOnce Sub-task Closed Andriy Redko

        Activity

          People

            reta Andriy Redko
            reta Andriy Redko
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: