[LUCENE-8757] Better Segment To Thread Mapping Algorithm - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 9.0
Component/s: None
Labels:
None

Lucene Fields:

New

Description

The current segments to threads allocation algorithm always allocates one thread per segment. This is detrimental to performance in case of skew in segment sizes since small segments also get their dedicated thread. This can lead to performance degradation due to context switching overheads.

A better algorithm which is cognizant of size skew would have better performance for realistic scenarios

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

image-2020-12-04-14-09-22-924.png
04/Dec/20 06:09
0.3 kB
hu
LUCENE-8757.patch
21/May/19 13:48
17 kB
Atri Sharma
LUCENE-8757.patch
21/May/19 03:25
17 kB
Atri Sharma
LUCENE-8757.patch
20/May/19 15:28
17 kB
Atri Sharma
LUCENE-8757.patch
20/May/19 11:29
14 kB
Atri Sharma
LUCENE-8757.patch
20/May/19 09:34
14 kB
Atri Sharma
LUCENE-8757.patch
13/May/19 09:47
14 kB
Atri Sharma
LUCENE-8757.patch
10/May/19 09:01
13 kB
Atri Sharma
LUCENE-8757.patch
07/May/19 15:07
12 kB
Atri Sharma
LUCENE-8757.patch
07/May/19 09:50
11 kB
Atri Sharma
LUCENE-8757.patch
03/May/19 09:15
11 kB
Atri Sharma

Issue Links

causes

LUCENE-8819 org.apache.lucene.search.TestTopDocsMerge.testSort_1 failure

Open

is related to

LUCENE-8829 TopDocs#Merge is Tightly Coupled To Number Of Collectors Involved

Resolved

Activity

People

Assignee:: Simon Willnauer

Reporter:: Atri Sharma

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 09/Apr/19 11:13

Updated:: 28/Aug/22 15:43

Resolved:: 21/May/19 18:24