[GEODE-8554] CI Failure: JMXMBeanReconnectDUnitTest.locatorMXBeansOnOtherLocatorAreRestoredAfterCrashedLocatorReturns

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.15.0
• Assignee: Kirk Lund
• Reporter: Jianxia Chen
• Created: 29/Sep/20 20:28
• Updated: 03/May/22 23:24
• Resolved: 03/May/22 23:24

Description

org.apache.geode.management.JMXMBeanReconnectDUnitTest > locatorMXBeansOnOtherLocatorAreRestoredAfterCrashedLocatorReturns FAILED
    org.apache.geode.test.dunit.RMIException: While invoking org.apache.geode.management.JMXMBeanReconnectDUnitTest$$Lambda$355/858468979.call in VM -1 running on Host 7a5c340f5c23 with 4 VMs
        at org.apache.geode.test.dunit.VM.executeMethodOnObject(VM.java:620)
        at org.apache.geode.test.dunit.VM.invoke(VM.java:472)
        at org.apache.geode.management.JMXMBeanReconnectDUnitTest.setUp(JMXMBeanReconnectDUnitTest.java:191)

        Caused by:
        org.awaitility.core.ConditionTimeoutException: Assertion condition defined as a lambda expression in org.apache.geode.management.JMXMBeanReconnectDUnitTest [GemFire mbeans on locator2] 
        Expecting HashSet:
         <[GemFire:type=Member,member=locator1,
            GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator2,
            GemFire:type=Member,member=server1,
            GemFire:service=Manager,type=Member,member=locator1,
            GemFire:service=Locator,type=Member,member=locator2,
            GemFire:type=Member,member=locator2,
            GemFire:service=Region,name=/region1,type=Member,member=server1,
            GemFire:service=FileUploader,type=Distributed,
            GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator2,
            GemFire:service=Manager,type=Member,member=locator2,
            GemFire:service=Locator,type=Member,member=locator1,
            GemFire:service=System,type=Distributed,
            GemFire:service=AccessControl,type=Distributed,
            GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Distributed,
            GemFire:service=Region,name=/region1,type=Distributed]>
        to contain:
         <[GemFire:type=Member,member=locator1,
            GemFire:service=Locator,type=Member,member=locator1,
            GemFire:service=Manager,type=Member,member=locator1,
            GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator1,
            GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator1]>
        but could not find the following element(s):
         <[GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator1,
            GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator1]>
         within 5 minutes.
            at org.awaitility.core.ConditionAwaiter.await(ConditionAwaiter.java:165)
            at org.awaitility.core.AssertionCondition.await(AssertionCondition.java:119)
            at org.awaitility.core.AssertionCondition.await(AssertionCondition.java:31)
            at org.awaitility.core.ConditionFactory.until(ConditionFactory.java:895)
            at org.awaitility.core.ConditionFactory.untilAsserted(ConditionFactory.java:679)
            at org.apache.geode.management.JMXMBeanReconnectDUnitTest.lambda$setUp$515fd116$3(JMXMBeanReconnectDUnitTest.java:192)
            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
            at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
            at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
            at java.lang.reflect.Method.invoke(Method.java:498)
            at org.apache.geode.test.dunit.internal.MethodInvoker.executeObject(MethodInvoker.java:123)
            at org.apache.geode.test.dunit.internal.RemoteDUnitVM.executeMethodOnObject(RemoteDUnitVM.java:78)
            at org.apache.geode.test.dunit.VM.executeMethodOnObject(VM.java:617)
            ... 2 more

            Caused by:
            java.lang.AssertionError: [GemFire mbeans on locator2] 
            Expecting HashSet:
             <[GemFire:type=Member,member=locator1,
                GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator2,
                GemFire:type=Member,member=server1,
                GemFire:service=Manager,type=Member,member=locator1,
                GemFire:service=Locator,type=Member,member=locator2,
                GemFire:type=Member,member=locator2,
                GemFire:service=Region,name=/region1,type=Member,member=server1,
                GemFire:service=FileUploader,type=Distributed,
                GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator2,
                GemFire:service=Manager,type=Member,member=locator2,
                GemFire:service=Locator,type=Member,member=locator1,
                GemFire:service=System,type=Distributed,
                GemFire:service=AccessControl,type=Distributed,
                GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Distributed,
                GemFire:service=Region,name=/region1,type=Distributed]>
            to contain:
             <[GemFire:type=Member,member=locator1,
                GemFire:service=Locator,type=Member,member=locator1,
                GemFire:service=Manager,type=Member,member=locator1,
                GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator1,
                GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator1]>
            but could not find the following element(s):
             <[GemFire:service=DiskStore,name=cluster_config,type=Member,member=locator1,
                GemFire:service=LockService,name=__CLUSTER_CONFIG_LS,type=Member,member=locator1]>
                at org.apache.geode.management.JMXMBeanReconnectDUnitTest.lambda$null$2(JMXMBeanReconnectDUnitTest.java:197)

Issue Links

• duplicates: GEODE-7710 CI Failure: JMXMBeanReconnectDUnitTest aka JmxServerReconnectDistributedTest fails intermittently because one locator is missing the LockServiceMXBean
• incorporates: GEODE-10148 [CI Failure] : JMXMBeanFederationDUnitTest > MBeanFederationAddRemoveServer FAILED
• is caused by: GEODE-7739 JMX managers may fail to federate mbeans for other members