Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3000

Optimize nested foreach

          Details

          • Type: Bug
          • Status: Open
          • Priority: Major
          • Resolution: Unresolved
          • Affects Version/s: 0.10.0
          • Fix Version/s: None
          • Component/s: impl
          • Labels:
            None

            Description

            In this Pig script:

            A = load 'data' as (a:chararray);
B = foreach A { c = UPPER(a); generate ((c eq 'TEST') ? 1 : 0), ((c eq 'DEV') ? 1 : 0); }

            The Eval function UPPER is called twice for each record.

            This should be optimized so that the UPPER is called only once for each record

              Attachments

              1. PIG-3000-6.patch
                23 kB
                Mona Chitnis
              2. unit_tests.patch
                10 kB
                Mona Chitnis

                Issue Links

                is part of

                Sub-task - The sub-task of the issue PIG-5256 Bytecode generation for POFilter and POForeach

                • Major - Major loss of function.
                • Patch Available
                relates to

                Bug - A problem which impairs or prevents the functions of the product. PIG-1633 Using an alias withing Nested Foreach causes indeterminate behaviour

                • Major - Major loss of function.
                • Open
                links to

                Web Link Reviewboard

                  Activity

                    People

                    • Assignee:
                      rohini Rohini Palaniswamy
                      Reporter:
                      rding Richard Ding
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      9 Start watching this issue

                      Dates

                      • Created:
                        Updated: