Cassandra
  1. Cassandra
  2. CASSANDRA-4282

Improve startup time by making row cache population multi threaded

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Fix Version/s: 1.2.0 beta 1
    • Component/s: None
    • Labels:
      None

      Description

      Attached patch multi threads the row cache population

      my small tests show improvements atleast;

      - 4 cores                                                                                                                                                                                              
      - 11G stress-generated data
      - page cache dropped between runs                                                                                                                                                                            
                                                                                                                                                                                                             
      single platter spinning disk:                                                                                                                                                   
      single threaded:                                                                                                                                                                                       
       INFO 10:18:21,365 completed loading (245562 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:32:43,738 completed loading (255106 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
      multi threaded:                                                                                                                                                                                        
       INFO 10:22:47,567 completed loading (213905 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:27:26,873 completed loading (214514 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
                                                                                                                                                                                                             
      ssd;                                                                                                                                                                                                   
      single threaded:                                                                                                                                                                                       
       INFO 10:40:49,079 completed loading (103883 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:43:45,799 completed loading (106913 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
      multi threaded:                                                                                                                                                                                        
       INFO 10:38:20,798 completed loading (57617 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                         
       INFO 10:47:20,339 completed loading (56682 ms; 311381 keys) row cache for Keyspace1.Standard1
      

        Activity

        Marcus Eriksson created issue -
        Marcus Eriksson made changes -
        Field Original Value New Value
        Attachment 0001-improve-startup-time-by-multi-threading-row-cache-re.patch [ 12529690 ]
        Jonathan Ellis made changes -
        Attachment 4282-v2.txt [ 12541984 ]
        Jonathan Ellis made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Assignee Jonathan Ellis [ jbellis ]
        Reviewer vijay2win@yahoo.com
        Jonathan Ellis made changes -
        Fix Version/s 1.2.0 [ 12323243 ]
        Fix Version/s 1.2.0 beta 1 [ 12319262 ]
        Jonathan Ellis made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Fix Version/s 1.2.0 beta 1 [ 12319262 ]
        Fix Version/s 1.2.0 [ 12323243 ]
        Resolution Fixed [ 1 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12670175 ] patch-available, re-open possible [ 12753209 ]
        Gavin made changes -
        Workflow patch-available, re-open possible [ 12753209 ] reopen-resolved, no closed status, patch-avail, testing [ 12758648 ]

          People

          • Assignee:
            Jonathan Ellis
            Reporter:
            Marcus Eriksson
            Reviewer:
            Vijay
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development