Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-9851

Write Durability Failures Even During Batch Commit Mode

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Normal
    • Resolution: Duplicate
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Environment:

      Debian, x86_64, Kernel 3.16.7

    • Severity:
      Normal

      Description

      Reproducible as of a66863861136a29dc04d7bc3b319f9f8fae0f49f on trunk, as well as in other recent commits.

      Durability of writes seems to be violated, even under batch commitlog mode. This issue was discovered by a test that adds a range of values to a CQL Set, with no deletes issued. The test is available here https://github.com/riptano/jepsen/blob/cassandra/cassandra/src/cassandra/collections/set.clj#L56.

      During this write pattern, random nodes in the 5 node cluster are kill -9ed. Once all nodes have been brought back up, another read at CL.ALL is issued. This read fails to return values that have previously been successfully read from the cluster. This problem is not reproducible on 2.1.* or 2.2.

      Log files from each node are attached.

        Attachments

        1. n1.log
          211 kB
          Joel Knighton
        2. n2.log
          214 kB
          Joel Knighton
        3. n3.log
          169 kB
          Joel Knighton
        4. n4.log
          172 kB
          Joel Knighton
        5. n5.log
          128 kB
          Joel Knighton

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jkni Joel Knighton
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: