Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3604

Implement replicated join in Tez

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • tez-branch
    • tez-branch
    • tez
    • None

    Description

      I propose we implement replicated join as follows-

      • Vertex 1: Loads replicated table and broadcasts it to vertex 2.
      • Vertex 2: Loads fragmented table and join it with broadcasted input from vertex 1.
      • New POPackage for vertex 2 that can consume a broadcast input and a file input needs to be implemented.

      Attachments

        1. PIG-3604-1.patch
          30 kB
          Cheolsoo Park
        2. PIG-3604-2.patch
          45 kB
          Cheolsoo Park

        Activity

          People

            cheolsoo Cheolsoo Park
            cheolsoo Cheolsoo Park
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: