Details

    • Type: Improvement
    • Status: Awaiting Feedback
    • Priority: Minor
    • Resolution: Unresolved
    • Fix Version/s: 4.x
    • Component/s: None
    • Labels:
      None

      Description

      Looking at a heap dump of 2.0 cluster, I found that majority of the objects are IndexInfo and its ByteBuffers. This is specially bad in endpoints with large CQL partitions. If a CQL partition is say 6,4GB, it will have 100K IndexInfo objects and 200K ByteBuffers. This will create a lot of churn for GC. Can this be improved by not creating so many objects?

        Attachments

        1. gc_collection_times_with_birch.png
          172 kB
          Michael Kjellman
        2. gc_collection_times_without_birch.png
          260 kB
          Michael Kjellman
        3. gc_counts_with_birch.png
          114 kB
          Michael Kjellman
        4. gc_counts_without_birch.png
          107 kB
          Michael Kjellman
        5. perf_cluster_1_with_birch_read_latency_and_counts.png
          78 kB
          Michael Kjellman
        6. perf_cluster_2_with_birch_read_latency_and_counts.png
          83 kB
          Michael Kjellman
        7. perf_cluster_2_with_birch_write_latency_and_counts.png
          80 kB
          Michael Kjellman
        8. perf_cluster_3_without_birch_write_latency_and_counts.png
          109 kB
          Michael Kjellman
        9. perf_cluster_1_with_birch_write_latency_and_counts.png
          77 kB
          Michael Kjellman
        10. perf_cluster_3_without_birch_read_latency_and_counts.png
          99 kB
          Michael Kjellman
        11. 0f8e28c220fd5af6c7b5dd2d3dab6936c4aa4b6b.patch
          5 kB
          Jeff Jirsa

          Issue Links

            Activity

              People

              • Assignee:
                mkjellman Michael Kjellman
                Reporter:
                kohlisankalp sankalp kohli
                Reviewer:
                Branimir Lambov
              • Votes:
                10 Vote for this issue
                Watchers:
                46 Start watching this issue

                Dates

                • Created:
                  Updated: