Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8757

Better Segment To Thread Mapping Algorithm

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 9.0
    • None
    • None
    • New

    Description

      The current segments to threads allocation algorithm always allocates one thread per segment. This is detrimental to performance in case of skew in segment sizes since small segments also get their dedicated thread. This can lead to performance degradation due to context switching overheads.

       

      A better algorithm which is cognizant of size skew would have better performance for realistic scenarios

      Attachments

        1. LUCENE-8757.patch
          11 kB
          Atri Sharma
        2. LUCENE-8757.patch
          11 kB
          Atri Sharma
        3. LUCENE-8757.patch
          12 kB
          Atri Sharma
        4. LUCENE-8757.patch
          13 kB
          Atri Sharma
        5. LUCENE-8757.patch
          14 kB
          Atri Sharma
        6. LUCENE-8757.patch
          14 kB
          Atri Sharma
        7. LUCENE-8757.patch
          14 kB
          Atri Sharma
        8. LUCENE-8757.patch
          17 kB
          Atri Sharma
        9. LUCENE-8757.patch
          17 kB
          Atri Sharma
        10. LUCENE-8757.patch
          17 kB
          Atri Sharma
        11. image-2020-12-04-14-09-22-924.png
          0.3 kB
          hu

        Issue Links

          Activity

            People

              simonw Simon Willnauer
              atris Atri Sharma
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: