[FLINK-9474] Add runtime support of distinct filter using ElasticBloomFilter

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Affects Version/s: 1.5.0
• Component/s: Table SQL / API
• Assignee: Sihua Zhou
• Reporter: Sihua Zhou
• Created: 30/May/18 05:34
• Updated: 30/Jan/19 10:40
• Resolved: 30/Jan/19 10:40

Description

We can implement an approximate version of "distinct filter" base on the "Elastic Bloom Filter", It could be very fast because we don't need to query the state anymore, its accuracy should could be configurable. e.g 95%, 98% and it might unable to support retraction.

Issue Links

• is blocked by: FLINK-8601 Introduce ElasticBloomFilter for Approximate calculation and other situations of performance optimization