Uploaded image for project: 'CXF'
  1. CXF
  2. CXF-8393

Umbrella issue to address fixing flaky tests

    XMLWordPrintableJSON

Details

    • Bug
    • Status: In Progress
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • Unknown

    Description

      There are a number of tests which are flaky and fail the builds from time to time. We should address those by fixing or at last, removing them altogether.

      Adding test retry to the offending modules (https://maven.apache.org/surefire/maven-surefire-plugin/examples/rerun-failing-tests.html) should help.

      [INFO] Results:
[INFO] 
[WARNING] Flakes: 
[WARNING] org.apache.cxf.transport.jms.RequestResponseTest.testRequestQueueResponseTempQueue
[ERROR]   Run 1: RequestResponseTest.testRequestQueueResponseTempQueue:41->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306 Can't receive the Conduit Message in 10 seconds
[INFO]   Run 2: PASS
[INFO] 
[WARNING] org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue
[ERROR]   Run 1: RequestResponseTest.testRequestTopicResponseStaticQueue:64->sendAndReceiveMessages:99->AbstractJMSTester.waitForReceiveInMessage:306 Can't receive the Conduit Message in 10 seconds
[ERROR]   Run 2: RequestResponseTest.testRequestTopicResponseStaticQueue:63->sendAndReceiveMessages:95->AbstractJMSTester.sendMessage:165->AbstractJMSTester.sendoutMessage:187 » Runtime Timeout receiving message with correlationId eb382e0774ca4c4f9f5bae1ae4dd147d0000000000000001
[INFO]   Run 3: PASS
[INFO] 
[INFO] 
[WARNING] Tests run: 65, Failures: 0, Errors: 0, Skipped: 1, Flakes: 2

      While the retrying does not fix the flaky tests, it should help reduce the number of builds that fail. The end goal is to fix the flaky tests.

      Attachments

        Issue Links

          relates to

          Test - A new unit, integration or system test. CXF-9036 JAXRS testThatNewSpanIsCreatedUsingAsyncInvocation tests failing on Windows ARM

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          links to

          Web Link GitHub Pull Request #760

          Web Link GitHub Pull Request #1084

          1.
          		 Fix org.apache.cxf.systest.jaxrs.JAXRSContinuationsServlet3Test.testCancelVoidOnResumedTest Sub-task Closed Andriy Redko
          2.
          		 Fix org.apache.cxf.workqueue.AutomaticWorkQueueTest.testEnqueueImmediate Sub-task Closed Andriy Redko
          3.
          		 Fix org.apache.cxf.systest.ws.rm.ProtocolVariationsTest.testRM10WSA200408Decoupled Sub-task Open Andriy Redko
          4.
          		 Fix org.apache.cxf.systest.ws.rm.SequenceTest.testOnewayAnonymousAcksSuppressedAsyncExecutor Sub-task Open Andriy Redko
          5.
          		 Fix org.apache.cxf.systest.ws.rm.DeliveryAssuranceOnewayTest.testInOrderAsyncExecutor Sub-task Open Andriy Redko
          6.
          		 Fix org.apache.cxf.transport.jms.uri.URIConfiguredConduitTest.testSendReceive Sub-task Open Andriy Redko
          7.
          		 Fix org.apache.cxf.systest.ws.rm.ManagedEndpointsTest.testManagedEndpointsOneway Sub-task Closed Andriy Redko
          8.
          		 Fix org.apache.cxf.transport.jms.util.MessageListenerTest.testNoTransaction Sub-task Closed Andriy Redko
          9.
          		 Fix org.apache.cxf.systest.ws.rm.ManagedEndpointsTest.testManagedEndpointsOneway12 Sub-task Closed Andriy Redko
          10.
          		 Fix org.apache.cxf.jaxrs.sse.client.SseEventSourceImplTest.testReconnectAndTwoEventsReceived Sub-task Closed Andriy Redko
          11.
          		 Fix org.apache.cxf.systest.ws.rm.DeliveryAssuranceOnewayTest.testExactlyOnceInOrder Sub-task Open Andriy Redko
          12.
          		 Fix org.apache.cxf.systest.jms.tx.JMSTransactionTest.testTransactionOneWay Sub-task Closed Andriy Redko
          13.
          		 Fix org.apache.cxf.jaxrs.client.logging.RESTLoggingTest.testBinary Sub-task Closed Andriy Redko
          14.
          		 Fix org.apache.cxf.systest.ws.rm.ProtocolVariationsTest.testDefaultDecoupled Sub-task Open Andriy Redko
          15.
          		 Fix org.apache.cxf.systest.jaxrs.spring.boot.SpringJaxrsTest.testJaxrsSuccessMetric Sub-task Closed Andriy Redko
          16.
          		 Fix org.apache.cxf.jaxrs.client.logging.RESTLoggingTest.testSlf4 Sub-task Closed Andriy Redko
          17.
          		 Fix org.apache.cxf.systest.jaxrs.JAXRSContinuationsServlet3Test.testSuspendSetTimeout Sub-task Closed Andriy Redko
          18.
          		 Fix org.apache.cxf.systest.ws.addressing.MAPTest.testImplicitMAPs Sub-task Open Andriy Redko
          19.
          		 Fix org.apache.cxf.osgi.itests.jaxrs.JaxRsServiceTest Sub-task Closed Andriy Redko
          20.
          		 Fix org.apache.cxf.transport.jms.util.MessageListenerTest.testWithJTA Sub-task Closed Andriy Redko
          21.
          		 Fix org.apache.cxf.systest.jaxrs.failover.FailoverTest.testSequentialStrategyWithDiffBaseAddresses Sub-task Open Andriy Redko
          22.
          		 Fix org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseTempQueue Sub-task Open Andriy Redko
          23.
          		 Fix org.apache.cxf.transport.jms.RequestResponseTest.testRequestTopicResponseStaticQueue Sub-task Reopened Andriy Redko
          24.
          		 Fix org.apache.cxf.transport.http.asyncclient.hc5.AsyncHTTPConduitTest.testResponseSameBufferSize Sub-task Closed Andriy Redko
          25.
          		 Fix org.apache.cxf.transport.http.netty.client.NettyHttpConduitTest.testCallAsyncCallbackInvokedOnlyOnce Sub-task Closed Andriy Redko

          Activity

            People

              reta Andriy Redko
              reta Andriy Redko
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated: