[FLINK-10993] Bring bloomfilter as a public API

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: API / DataStream
• Assignee: vinoyang
• Reporter: vinoyang
• Created: 23/Nov/18 07:16
• Updated: 02/Oct/19 17:45
• Resolved: 30/Nov/18 08:08

Description

Flink internally provides an implementation of BloomFilter, but only for internal optimization, and does not provide APIs for public access.

Here is a user mail discussion before : http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Bloom-filter-in-Flink-td10608.html

Considering that many users have the need to "determine duplicates" in streaming computing, I think it would make sense to provide such an API.

In addition, Spark has provided BloomFilter as a public API : 

val bf = df.stat.bloomFilter("dd",dataLen,0.01)
val rightNum = rdd.map(x=>(x.toInt,bf.mightContainString(x)))

 

 

Issue Links

• duplicates: FLINK-8601 Introduce ElasticBloomFilter for Approximate calculation and other situations of performance optimization