[DRILL-2725] Faster work assignment logic

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: Storage - Other
• Assignee: Steven Phillips
• Reporter: Steven Phillips
• Created: 08/Apr/15 23:29
• Updated: 28/Apr/15 20:21
• Resolved: 28/Apr/15 20:21

Description

The current AssignmentCreator logic for assigning work to drillbits takes a non-negligible amount of time once the number of work units is more than a few thousand

We need a new algorithm to that will cut this time down to less than a second, even for tables with more than 100K files.