Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None

      Description

      I propose we implement replicated join as follows-

      • Vertex 1: Loads replicated table and broadcasts it to vertex 2.
      • Vertex 2: Loads fragmented table and join it with broadcasted input from vertex 1.
      • New POPackage for vertex 2 that can consume a broadcast input and a file input needs to be implemented.
      1. PIG-3604-1.patch
        30 kB
        Cheolsoo Park
      2. PIG-3604-2.patch
        45 kB
        Cheolsoo Park

        Activity

        Cheolsoo Park created issue -
        Hide
        Cheolsoo Park added a comment -
        Show
        Cheolsoo Park added a comment - RB link- https://reviews.apache.org/r/16313/
        Cheolsoo Park made changes -
        Field Original Value New Value
        Attachment PIG-3604-1.patch [ 12619031 ]
        Cheolsoo Park made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Cheolsoo Park added a comment -

        Uploading the 2nd patch.

        Show
        Cheolsoo Park added a comment - Uploading the 2nd patch.
        Cheolsoo Park made changes -
        Attachment PIG-3604-2.patch [ 12619256 ]
        Hide
        Rohini Palaniswamy added a comment -

        +1

        Show
        Rohini Palaniswamy added a comment - +1
        Hide
        Cheolsoo Park added a comment -

        Committed to tez branch. Thank you Rohini for the review!

        Show
        Cheolsoo Park added a comment - Committed to tez branch. Thank you Rohini for the review!
        Cheolsoo Park made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Daniel Dai made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        15d 20h 44m 1 Cheolsoo Park 17/Dec/13 03:52
        Patch Available Patch Available Resolved Resolved
        1d 14h 59m 1 Cheolsoo Park 18/Dec/13 18:51
        Resolved Resolved Closed Closed
        337d 11h 7m 1 Daniel Dai 21/Nov/14 05:59

          People

          • Assignee:
            Cheolsoo Park
            Reporter:
            Cheolsoo Park
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development