Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-674

New SSTable Format

Agile BoardAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Normal
    • Resolution: Won't Fix
    • None
    • None
    • None

    Description

      Various tickets exist due to limitations in the SSTable file format, including #16, #47 and #328. Attached is a proposed design/implementation of a new file format for SSTables that addresses a few of these limitations.

      This v2 implementation is not ready for serious use: see comments for remaining issues. It is roughly the format described here: http://wiki.apache.org/cassandra/FileFormatDesignDoc

      Attachments

        1. 674-v1.diff
          252 kB
          Stu Hood
        2. 674-v2.tgz
          44 kB
          Stu Hood
        3. 674-v3.tgz
          66 kB
          Stu Hood
        4. 674-ycsb.log
          128 kB
          Stu Hood
        5. trunk-ycsb.log
          137 kB
          Stu Hood

        Issue Links

        blocks

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-598 SuperColumns need to be indexed

        • Normal -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2319 Promote row index

        • Normal -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-494 add remove_slice to the api

        • Low -
        • Resolved
        is blocked by

        New Feature - A new feature of the product, which has yet to be developed. CASSANDRA-2398 Type specific compression

        • Normal -
        • Resolved

        New Feature - A new feature of the product, which has yet to be developed. CASSANDRA-3067 Simple SSTable Pluggability

        • Normal -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2576 Rewrite into new file post streaming

        • Normal -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2629 Move key reads into SSTableIterators

        • Normal -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-389 SSTable Versioning

        • Low -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2062 Better control of iterator consumption

        • Low -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2144 Don't slurp rows into memory during export

        • Low -
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-2145 Simplify ColumnSortedMap

        • Low -
        • Resolved
        is depended upon by

        Improvement - An improvement or enhancement to an existing feature or task. CASSANDRA-808 Need a way to skip corrupted data in SSTables

        • Low -
        • Resolved
        is related to

        New Feature - A new feature of the product, which has yet to be developed. AVRO-757 Allow a DataFile to be reopened without reading the head

        • Major - Major loss of function.
        • Closed

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            stuhood Stu Hood Assign to me
            stuhood Stu Hood
            Stu Hood
            Votes:
            16 Vote for this issue
            Watchers:
            40 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment