Uploaded image for project: 'Lucene - Core'
  1. Lucene - Core
  2. LUCENE-8757

Better Segment To Thread Mapping Algorithm

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: master (9.0), 8.2
    • Component/s: None
    • Labels:
      None
    • Lucene Fields:
      New

      Description

      The current segments to threads allocation algorithm always allocates one thread per segment. This is detrimental to performance in case of skew in segment sizes since small segments also get their dedicated thread. This can lead to performance degradation due to context switching overheads.

       

      A better algorithm which is cognizant of size skew would have better performance for realistic scenarios

        Attachments

        1. LUCENE-8757.patch
          11 kB
          Atri Sharma
        2. LUCENE-8757.patch
          11 kB
          Atri Sharma
        3. LUCENE-8757.patch
          12 kB
          Atri Sharma
        4. LUCENE-8757.patch
          13 kB
          Atri Sharma
        5. LUCENE-8757.patch
          14 kB
          Atri Sharma
        6. LUCENE-8757.patch
          14 kB
          Atri Sharma
        7. LUCENE-8757.patch
          14 kB
          Atri Sharma
        8. LUCENE-8757.patch
          17 kB
          Atri Sharma
        9. LUCENE-8757.patch
          17 kB
          Atri Sharma
        10. LUCENE-8757.patch
          17 kB
          Atri Sharma

          Issue Links

            Activity

              People

              • Assignee:
                simonw Simon Willnauer
                Reporter:
                atris Atri Sharma
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: