Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-4282

Improve startup time by making row cache population multi threaded

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Low
    • Resolution: Fixed
    • 1.2.0 beta 1
    • None
    • None

    Description

      Attached patch multi threads the row cache population

      my small tests show improvements atleast;

      - 4 cores                                                                                                                                                                                              
      - 11G stress-generated data
      - page cache dropped between runs                                                                                                                                                                            
                                                                                                                                                                                                             
      single platter spinning disk:                                                                                                                                                   
      single threaded:                                                                                                                                                                                       
       INFO 10:18:21,365 completed loading (245562 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:32:43,738 completed loading (255106 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
      multi threaded:                                                                                                                                                                                        
       INFO 10:22:47,567 completed loading (213905 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:27:26,873 completed loading (214514 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
                                                                                                                                                                                                             
      ssd;                                                                                                                                                                                                   
      single threaded:                                                                                                                                                                                       
       INFO 10:40:49,079 completed loading (103883 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
       INFO 10:43:45,799 completed loading (106913 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                        
      multi threaded:                                                                                                                                                                                        
       INFO 10:38:20,798 completed loading (57617 ms; 311381 keys) row cache for Keyspace1.Standard1                                                                                                         
       INFO 10:47:20,339 completed loading (56682 ms; 311381 keys) row cache for Keyspace1.Standard1
      

      Attachments

        1. 4282-v2.txt
          7 kB
          Jonathan Ellis
        2. 0001-improve-startup-time-by-multi-threading-row-cache-re.patch
          3 kB
          Marcus Eriksson

        Activity

          People

            jbellis Jonathan Ellis
            marcuse Marcus Eriksson
            Jonathan Ellis
            Vijay
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: