Pig
  1. Pig
  2. PIG-3882

Multiquery off mode execution is not done in batch and very inefficient

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.12.0
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Currently, if it is multiquery off mode, the pig script is executed whenever a STORE is encountered. This becomes even more inefficient in Tez as multiple DAGs are launched. And it is also not possible to do explain if multiquery is off because of this. Should switch to batch mode. Only difference should be that MultiQueryOptimizer is not applied in multiquery off mode.

      1. PIG-3882-1.patch
        4 kB
        Rohini Palaniswamy

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        14m 14s 1 Rohini Palaniswamy 11/Apr/14 00:27
        Patch Available Patch Available Resolved Resolved
        14h 31m 1 Rohini Palaniswamy 11/Apr/14 14:58
        Resolved Resolved Closed Closed
        87d 4h 9m 1 Daniel Dai 07/Jul/14 19:08
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Rohini Palaniswamy made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Rohini Palaniswamy added a comment -

        Committed to trunk. Thanks for the review Daniel

        Show
        Rohini Palaniswamy added a comment - Committed to trunk. Thanks for the review Daniel
        Hide
        Daniel Dai added a comment -

        +1

        Show
        Daniel Dai added a comment - +1
        Rohini Palaniswamy made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Rohini Palaniswamy made changes -
        Field Original Value New Value
        Attachment PIG-3882-1.patch [ 12639681 ]
        Rohini Palaniswamy created issue -

          People

          • Assignee:
            Rohini Palaniswamy
            Reporter:
            Rohini Palaniswamy
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development