Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    1. PIG-3647-1.patch
      32 kB
      Daniel Dai
    2. PIG-3647-3.patch
      38 kB
      Daniel Dai

      Activity

      Hide
      Daniel Dai added a comment -

      Upload the patch checked in.

      Show
      Daniel Dai added a comment - Upload the patch checked in.
      Hide
      Daniel Dai added a comment -

      Patch committed to tez branch. Thanks Rohini for review. Review comments is on RB.

      Show
      Daniel Dai added a comment - Patch committed to tez branch. Thanks Rohini for review. Review comments is on RB.
      Hide
      Daniel Dai added a comment -
      Show
      Daniel Dai added a comment - RB link: https://reviews.apache.org/r/16614/
      Hide
      Daniel Dai added a comment -

      The implement uses 2 DAG:
      DAG 1. Build index for right input
      DAG 2. Do merge join using the index

      It is possible to use 1 DAG, however, currently there are too much logic inside loader (MergeJoinIndexer to build index, DefaultIndexableLoader to read index), migrate those will take time. I think we'd better move on and revisit later.

      Show
      Daniel Dai added a comment - The implement uses 2 DAG: DAG 1. Build index for right input DAG 2. Do merge join using the index It is possible to use 1 DAG, however, currently there are too much logic inside loader (MergeJoinIndexer to build index, DefaultIndexableLoader to read index), migrate those will take time. I think we'd better move on and revisit later.

        People

        • Assignee:
          Daniel Dai
          Reporter:
          Daniel Dai
        • Votes:
          0 Vote for this issue
          Watchers:
          1 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development