Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3882

Multiquery off mode execution is not done in batch and very inefficient

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, if it is multiquery off mode, the pig script is executed whenever a STORE is encountered. This becomes even more inefficient in Tez as multiple DAGs are launched. And it is also not possible to do explain if multiquery is off because of this. Should switch to batch mode. Only difference should be that MultiQueryOptimizer is not applied in multiquery off mode.

      1. PIG-3882-1.patch
        4 kB
        Rohini Palaniswamy

        Activity

        Hide
        daijy Daniel Dai added a comment -

        +1

        Show
        daijy Daniel Dai added a comment - +1
        Hide
        rohini Rohini Palaniswamy added a comment -

        Committed to trunk. Thanks for the review Daniel

        Show
        rohini Rohini Palaniswamy added a comment - Committed to trunk. Thanks for the review Daniel

          People

          • Assignee:
            rohini Rohini Palaniswamy
            Reporter:
            rohini Rohini Palaniswamy
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development