Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-13484

Truncate the list of SSTableReaders logged when there is insufficient space on disk during compaction

Agile BoardAttach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Low
    • Resolution: Unresolved
    • Fix Version/s: None
    • Component/s: Legacy/Observability
    • Labels:
      None

      Description

      In the CompactionTask class, there is an expression `StringUtils.join(transaction.originals(), ", ")` (present since 1.0 in the form: `StringUtils.join(toCompact, ", ")`) (nowadays in method `reduceScopeForLimitedSpace`).

      If the set of SSTableReader is very large, then the generated log line, which contains full file paths for each reader, will be enormous. This is specially the case when dealing with SSTable files generated from big data sets using CQLSSTableWriter, since it will create many small files. (Over 40k in my case. The single log line will be well in the 10's of MB, potentially causing problems in some log viewers.) To make matters worse, reduceScopeForLimitedSpace() is called multiple times in checkAvailableDiskSpace().

        Attachments

          Activity

            People

            • Assignee:
              Unassigned Assign to me
              Reporter:
              garciat Gabriel Garcia

              Dates

              • Created:
                Updated:

                Issue deployment