Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-607

Utilize intermediate results instead of re-execution

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Critical
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      This is the long existing problem. intermediate results are not reused. Every STORE or DUMP are executed in a separate plan and thus everything it needs are re-executed. This is really a terrible issue that should be fixed asap.

      Attachments

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. PIG-614 reduce io during sharing scans of the same input datasets

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. PIG-608 Compile or validate the whole script before execution

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              yhan Yiping Han
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: