Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-4925

Support for passing the bloom filter to the Bloom UDF

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.17.0
    • None
    • None
    • Reviewed

    Description

      Currently the Bloom Filter from BuildBloom has to be stored to HDFS to be able to be used in Bloom UDF. Most of the time the bloom filter is not reused and so have to be deleted after the end of the script. The load/store also forces multiple DAGs. If it was passed as a scalar, then it would be simpler and more efficient.

      Attachments

        1. PIG-4925-1.patch
          9 kB
          Rohini Palaniswamy

        Issue Links

          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. PIG-2348 Bloom should be able to take a relation or a file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              rohini Rohini Palaniswamy
              rohini Rohini Palaniswamy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: