[DRILL-5046] Add documentation for directory based partition pruning

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.9.0
• Component/s: Documentation
• Assignee: Bridget Bevens
• Reporter: Rahul Kumar Challapalli
• Created: 16/Nov/16 20:38
• Updated: 04/Nov/19 12:44

Description

Drill's documentation for partition pruning should cover the below 2 features

1. Directory based partition pruning
2. Partition pruning based on auto-partitioned parquet files

The first one seems to be missing from our documentation. At the very least we should cover

a. How we can leverage this feature to avoid full table scans
b. How this feature works in-conjunction with metadata cache pruning
c. A few examples which involve using wildcards for one of the sub-directories