[KUDU-2162] Expose stats about scan filters

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: client
• Code Review: https://gerrit.cloudera.org/c/8375/
• Assignee: Thomas D'Silva
• Reporter: Thomas Tauber-Marshall
• Created: 28/Sep/17 21:35
• Updated: 21/Nov/19 23:26
• Resolved: 21/Nov/19 22:41

Description

Impala is working on implementing runtime filters that get pushed down into Kudu using KuduScanner::AddConjunctPredicate()

It would be useful for perf analysis and debugging to be able to include info in Impala's runtime profile about the effectiveness of the filters, eg. number of rows that are filtered.

This would probably require at least two counters:

• # of blocks that are entirely skipped
• # of rows that are filtered from blocks that aren't entirely skipped