[PIG-2348] Bloom should be able to take a relation or a file

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 0.11
• Component/s: internal-udfs
• Assignee: Alan Gates
• Reporter: Alan Gates
• Created: 03/Nov/11 01:12
• Updated: 23/Jun/16 18:39
• Resolved: 23/Jun/16 18:39

Description

Currently Bloom requires the user to have stored the result of a previous query using BuildBloom to an HDFS file before it can be used. This means the user must submit an "exec" between this store and the filter that uses Bloom if they are to be used in the same script.

If Bloom could take a relation as its first input (ala the relation cast to scalar) then users would not need to put an exec in their script or manage a storage location on HDFS.

Sometimes storing the results in the file makes sense, so we don't want to remove the current behavior, just add another option.

Issue Links

• is duplicated by: PIG-4925 Support for passing the bloom filter to the Bloom UDF
• is related to: PIG-2328 Add builtin UDFs for building and using bloom filters