[CARBONDATA-3974] Improve partition purning performance in presto carbon integration

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.0
• Assignee: Ajantha Bhat
• Reporter: Ajantha Bhat
• Created: 07/Sep/20 11:24
• Updated: 12/Sep/20 21:45
• Resolved: 12/Sep/20 11:02

Description

a)  For 200K segments table in cloud, presto partition query was taking more than 5 hours. the reason is it was reading all segment files for partition pruning. Now it is less than a minute !

 

b) If the query filter is less than or greater than or more than one value. Partition pruning is not working in presto (due to missing code in presto-carbon integration)