Cassandra
  1. Cassandra
  2. CASSANDRA-4175

Reduce memory, disk space, and cpu usage with a column name/id map

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Fix Version/s: 3.x
    • Component/s: None
    • Labels:

      Description

      We spend a lot of memory on column names, both transiently (during reads) and more permanently (in the row cache). Compression mitigates this on disk but not on the heap.

      The overhead is significant for typical small column values, e.g., ints.

      Even though we intern once we get to the memtable, this affects writes too via very high allocation rates in the young generation, hence more GC activity.

      Now that CQL3 provides us some guarantees that column names must be defined before they are inserted, we could create a map of (say) 32-bit int column id, to names, and use that internally right up until we return a resultset to the client.

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Jason Brown
              Reporter:
              Jonathan Ellis
            • Votes:
              10 Vote for this issue
              Watchers:
              41 Start watching this issue

              Dates

              • Created:
                Updated:

                Development