Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-946

Combiner optimizer does not optimize when limit follow group, foreach

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.3.0
    • 0.9.0
    • None
    • None

    Description

      The following script is combinable but is not optimized:
      a = load '/user/pig/tests/data/singlefile/studenttab10k';
      b = group a by $1;
      c = foreach b generate group, AVG(a.$2);
      d = limit c 10;
      dump d;

      Attachments

        1. PIG-946.1.patch
          5 kB
          Thejas Nair
        2. PIG-946-codechange-draft.patch
          1 kB
          Pradeep Kamath

        Activity

          People

            thejas Thejas Nair
            pkamath Pradeep Kamath
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: