Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-7545

Hints for a down node are written to a single partition in system.hints on the coordinator leading to contention

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Normal
    • Resolution: Duplicate
    • None
    • None
    • None
    • Normal

    Description

      The worst side effect is potentially orders of magnitude larger than suspected memory allocation due to a race condition updating the columns in the memtable (see CASSANDRA-7546)

      That said, having so many hints in a single partition has other negative side effects (non linear growth of sorted tree data structure overhead in memtable, just plain large number of tombstones in a row etc.)

      Ideally, the hints would be partitioned by both the nodeUUID, and a fixed number of (say 4) bits of a hash of the original rowmutation's partition key... even this small spreading of load has a significant improvement.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              graham sanderson graham sanderson
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: