Uploaded image for project: 'Falcon'
  1. Falcon
  2. FALCON-777

UT intermittent failures in Messaging tests depending on Thread.sleep

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.5, 0.6
    • 0.6
    • None

    Description

      UT test fails org.apache.falcon.messaging.FeedProducerTest.testLogFile intermittently.

      Error Message:
      expected:</falcon/feed/agg-logs/path1/2010/10/10/20> but was:</falcon/feed/agg-logs/path1/2010/10/10/21>

      java.lang.AssertionError: expected:</falcon/feed/agg-logs/path1/2010/10/10/20> but was:</falcon/feed/agg-logs/path1/2010/10/10/21>
      	at org.testng.Assert.fail(Assert.java:89)
      	at org.testng.Assert.failNotEquals(Assert.java:489)
      	at org.testng.Assert.assertEquals(Assert.java:118)
      	at org.testng.Assert.assertEquals(Assert.java:171)
      	at org.testng.Assert.assertEquals(Assert.java:181)
      	at org.apache.falcon.messaging.FeedProducerTest.consumer(FeedProducerTest.java:182)
      	at org.apache.falcon.messaging.FeedProducerTest.access$000(FeedProducerTest.java:50)
      Standard Output
      
      2014-09-30 13:07:04,014 INFO  - Deleted feed instance paths file:jail://testCluster:00/falcon/feed/agg-logs/instance-2012-01-01-10-00.csv (EvictedInstanceSerDe:105)
      2014-09-30 13:07:04,014 DEBUG - Returning instance paths for feed /falcon/feed/agg-logs/path1/2010/10/10/20,/falcon/feed/agg-logs/path1/2010/10/10/21,/falcon/feed/agg-logs/path1/2010/10/10/22,/falcon/feed/agg-logs/path1/2010/10/10/23 (EvictedInstanceSerDe:110)
      2014-09-30 13:07:04,027 INFO  - Sending message: {workflowStartTime=null, falconInputNames=null, timeStamp=2012-01-01-01-00, falconInPaths=null, workflowDuration=null, feedNames=click-logs, runId=1, entityType=FEED, nominalTime=2011-01-01-01-00, workflowUser=falcon, feedInstancePaths=/falcon/feed/agg-logs/path1/2010/10/10/20, workflowEndTime=null, operation=DELETE, logDir=/falcon/feed/agg-logs/, falconInputFeedStorageTypes=null, userWorkflowEngine=null, workflowEngineUrl=null, brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, topicName=Falcon.process1.click-logs, brokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, status=SUCCEEDED, brokerTTL=10, userWorkflowName=null, entityName=Falcon.process1.click-logs, contextType=POST_PROCESSING, contextFile=/falcon/feed/agg-logs/Falcon.process1.click-logs-wf-post-exec-context.json, userBrokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, falconInputFeeds=null, workflowId=workflow-01-00, userWorkflowVersion=null, cluster=corp, subflowId=null} (JMSMessageProducer:172)
      2014-09-30 13:07:04,085 INFO  - Sending message: {workflowStartTime=null, falconInputNames=null, timeStamp=2012-01-01-01-00, falconInPaths=null, workflowDuration=null, feedNames=click-logs, runId=1, entityType=FEED, nominalTime=2011-01-01-01-00, workflowUser=falcon, feedInstancePaths=/falcon/feed/agg-logs/path1/2010/10/10/21, workflowEndTime=null, operation=DELETE, logDir=/falcon/feed/agg-logs/, falconInputFeedStorageTypes=null, userWorkflowEngine=null, workflowEngineUrl=null, brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, topicName=Falcon.process1.click-logs, brokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, status=SUCCEEDED, brokerTTL=10, userWorkflowName=null, entityName=Falcon.process1.click-logs, contextType=POST_PROCESSING, contextFile=/falcon/feed/agg-logs/Falcon.process1.click-logs-wf-post-exec-context.json, userBrokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, falconInputFeeds=null, workflowId=workflow-01-00, userWorkflowVersion=null, cluster=corp, subflowId=null} (JMSMessageProducer:172)
      2014-09-30 13:07:04,089 INFO  - Sending message: {workflowStartTime=null, falconInputNames=null, timeStamp=2012-01-01-01-00, falconInPaths=null, workflowDuration=null, feedNames=click-logs, runId=1, entityType=FEED, nominalTime=2011-01-01-01-00, workflowUser=falcon, feedInstancePaths=/falcon/feed/agg-logs/path1/2010/10/10/22, workflowEndTime=null, operation=DELETE, logDir=/falcon/feed/agg-logs/, falconInputFeedStorageTypes=null, userWorkflowEngine=null, workflowEngineUrl=null, brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, topicName=Falcon.process1.click-logs, brokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, status=SUCCEEDED, brokerTTL=10, userWorkflowName=null, entityName=Falcon.process1.click-logs, contextType=POST_PROCESSING, contextFile=/falcon/feed/agg-logs/Falcon.process1.click-logs-wf-post-exec-context.json, userBrokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, falconInputFeeds=null, workflowId=workflow-01-00, userWorkflowVersion=null, cluster=corp, subflowId=null} (JMSMessageProducer:172)
      2014-09-30 13:07:04,091 INFO  - Sending message: {workflowStartTime=null, falconInputNames=null, timeStamp=2012-01-01-01-00, falconInPaths=null, workflowDuration=null, feedNames=click-logs, runId=1, entityType=FEED, nominalTime=2011-01-01-01-00, workflowUser=falcon, feedInstancePaths=/falcon/feed/agg-logs/path1/2010/10/10/23, workflowEndTime=null, operation=DELETE, logDir=/falcon/feed/agg-logs/, falconInputFeedStorageTypes=null, userWorkflowEngine=null, workflowEngineUrl=null, brokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, userBrokerImplClass=org.apache.activemq.ActiveMQConnectionFactory, topicName=Falcon.process1.click-logs, brokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, status=SUCCEEDED, brokerTTL=10, userWorkflowName=null, entityName=Falcon.process1.click-logs, contextType=POST_PROCESSING, contextFile=/falcon/feed/agg-logs/Falcon.process1.click-logs-wf-post-exec-context.json, userBrokerUrl=vm://localhost?broker.useJmx=false&broker.persistent=true, falconInputFeeds=null, workflowId=workflow-01-00, userWorkflowVersion=null, cluster=corp, subflowId=null} (JMSMessageProducer:172)
      Consumed: ActiveMQMapMessage {commandId = 10, responseRequired = true, messageId = ID:ip-10-0-0-5.ec2.internal-60629-1412096823021-2:2:2:1:1, originalDestination = null, originalTransactionId = null, producerId = ID:ip-10-0-0-5.ec2.internal-60629-1412096823021-2:2:2:1, destination = topic://Falcon.process1.click-logs, transactionId = null, expiration = 1412097424085, timestamp = 1412096824085, arrival = 0, brokerInTime = 1412096824087, brokerOutTime = 1412096824088, correlationId = null, replyTo = null, persistent = true, type = null, priority = 4, groupID = null, groupSequence = 0, targetConsumerId = null, compressed = false, userID = null, content = org.apache.activemq.util.ByteSequence@1d0027f5, marshalledProperties = null, dataStructure = null, redeliveryCounter = 0, size = 2081, properties = null, readOnlyProperties = true, readOnlyBody = true, droppable = false} ActiveMQMapMessage{ theTable = {} }
      

      Attachments

        1. FALCON-777.patch
          2 kB
          Sowmya Ramesh
        2. FALCON-777.v2.patch
          15 kB
          Sowmya Ramesh

        Activity

          People

            sowmyaramesh Sowmya Ramesh
            sowmyaramesh Sowmya Ramesh
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: