[CASSANDRA-17456] Test Failures: write_failures_test.TestMultiDCWriteFailures.test_oversized_mutation

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 4.1-alpha1, 4.1
• Component/s: CI
• Bug Category: Correctness - Test Failure
• Severity: Normal
• Complexity: Normal
• Discovered By: Unit Test
• Platform: All
• Since Version: 4.1

Source Control Link

Committed as 9f3bc657273dfa9e20d233636adf662904f01f34 to 4.1 and 11bdf1bf8038fa7f872fe9161a0568d023e6cfac to trunk.

Test and Documentation Plan

I made the existing dtest applicable to C* versions until 4.0.x and added an in-jvm dtest to cover rejection of oversized mutations on insert.

• Assignee: Alex Sorokoumov Assign to me
• Reporter: Ekaterina Dimitrova

Authors

Alex Sorokoumov

Reviewers

Andres de la Peña, Josh McKenzie

• Created: 18/Mar/22 20:07
• Updated: 27/May/22 19:24
• Resolved: 09/May/22 09:05

Description

https://ci-cassandra.apache.org/job/Cassandra-trunk/1002/testReport/dtest-offheap.write_failures_test/TestMultiDCWriteFailures/test_oversized_mutation/

Error Message
AssertionError: assert 0 == 8  +  where 8 = <bound method JolokiaAgent.read_attribute of <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>>('org.apache.cassandra.metrics:type=Storage,name=TotalHints', 'Count')  +    where <bound method JolokiaAgent.read_attribute of <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>> = <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>.read_attribute  +    and   'org.apache.cassandra.metrics:type=Storage,name=TotalHints' = make_mbean('metrics', type='Storage', name='TotalHints')
Stacktrace
self = <write_failures_test.TestMultiDCWriteFailures object at 0x7f1fca9dac40>

    def test_oversized_mutation(self):
        """
            Test that multi-DC write failures return operation failed rather than a timeout.
            @jira_ticket CASSANDRA-16334.
            """
    
        cluster = self.cluster
        cluster.populate([2, 2])
        cluster.set_configuration_options(values={'max_mutation_size_in_kb': 128})
        cluster.start()
    
        node1 = cluster.nodelist()[0]
        session = self.patient_exclusive_cql_connection(node1)
    
        session.execute("CREATE KEYSPACE k WITH replication = {'class': 'NetworkTopologyStrategy', 'dc1': 2, 'dc2': 2}")
        session.execute("CREATE TABLE k.t (key int PRIMARY KEY, val blob)")
    
        payload = '1' * 1024 * 256
        query = "INSERT INTO k.t (key, val) VALUES (1, textAsBlob('{}'))".format(payload)
    
        assert_write_failure(session, query, ConsistencyLevel.LOCAL_ONE)
        assert_write_failure(session, query, ConsistencyLevel.ONE)
    
        # verify that no hints are created
        with JolokiaAgent(node1) as jmx:
>           assert 0 == jmx.read_attribute(make_mbean('metrics', type='Storage', name='TotalHints'), 'Count')
E           AssertionError: assert 0 == 8
E            +  where 8 = <bound method JolokiaAgent.read_attribute of <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>>('org.apache.cassandra.metrics:type=Storage,name=TotalHints', 'Count')
E            +    where <bound method JolokiaAgent.read_attribute of <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>> = <tools.jmxutils.JolokiaAgent object at 0x7f1fca78dac0>.read_attribute
E            +    and   'org.apache.cassandra.metrics:type=Storage,name=TotalHints' = make_mbean('metrics', type='Storage', name='TotalHints')

write_failures_test.py:277: AssertionError
REST API
CloudBees CI Client Controller 2.319.3.4-rolling

Issue Links

• is related to: CASSANDRA-17164 CEP-14: Paxos Improvements
• links to: PR trunk