[ARROW-2144] [JS] Don't repeat dictionary lookups in DataFrame ops

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: JS-0.3.0
• Component/s: JavaScript
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/18111
• Assignee: Brian Hulette
• Reporter: Brian Hulette
• Created: 12/Feb/18 20:08
• Updated: 11/Jan/23 07:19
• Resolved: 19/Feb/18 17:47

Description

Currently we repeat dictionary lookups every time we bind a new record batch when doing an equality check in a DataFrame op (https://github.com/apache/arrow/blob/master/js/src/predicate.ts#L143).

In most cases the dictionary won't be changing between record batches, so we should remember these reverse dictionary lookups, either permanently, or at least for the duration of the current operation.

Issue Links

• links to: GitHub Pull Request #1599