[CARBONDATA-2134] Prevent implicit column filter list from getting serialized while submitting task to executor

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.1
• Assignee: Manish Gupta
• Reporter: Manish Gupta
• Created: 06/Feb/18 08:46
• Updated: 04/Mar/18 11:47
• Resolved: 04/Mar/18 11:47

Description

*Problem*
In the current store blocklet pruning in driver and no further pruning takes place in the executor side. But still the implicit column filter list being sent to executor. As the size of list grows the cost of serializing and deserializing the list is increasing which can impact the query performance.

*Solution*
Remove the list from the filter expression before submitting the task to executor.

Issue Links

• links to: GitHub Pull Request #1935