Pig
  1. Pig
  2. PIG-4008

Pig code change to enable Tez Local mode

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: tez
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Once pig specifes using local mode and tez framework, it will pass local parameter to tez and enable tez to use local mode.

      1. PIG-4008.patch
        0.9 kB
        Chen He
      2. PIG-4008-v2.patch
        0.8 kB
        Chen He
      3. PIG-4008-3.patch
        0.8 kB
        Daniel Dai
      4. PIG-4008-4.patch
        2 kB
        Daniel Dai

        Issue Links

          Activity

          Hide
          Daniel Dai added a comment -

          Patch committed to trunk. Thanks Chen He!

          Show
          Daniel Dai added a comment - Patch committed to trunk. Thanks Chen He !
          Hide
          Chen He added a comment -

          multiDAG will be considered in TEZ-1376. Thank you Daniel Dai and Cheolsoo Park

          Show
          Chen He added a comment - multiDAG will be considered in TEZ-1376 . Thank you Daniel Dai and Cheolsoo Park
          Hide
          Daniel Dai added a comment -

          Another update after TEZ-1343 check in. Now tez local mode should work in most cases. Siddharth Seth also point out if Pig submit multiple DAG simultaneously, local mode will fail. But what we have right now is already very useful, so I would like to check this in and improve over time.

          Show
          Daniel Dai added a comment - Another update after TEZ-1343 check in. Now tez local mode should work in most cases. Siddharth Seth also point out if Pig submit multiple DAG simultaneously, local mode will fail. But what we have right now is already very useful, so I would like to check this in and improve over time.
          Hide
          Daniel Dai added a comment -

          A small fix to improve the usability. User don't need to set PIG_CLASSPATH and tez.lib.uris when using tez_local.

          Show
          Daniel Dai added a comment - A small fix to improve the usability. User don't need to set PIG_CLASSPATH and tez.lib.uris when using tez_local.
          Hide
          Chen He added a comment -

          updated according to latest pig.

          Show
          Chen He added a comment - updated according to latest pig.
          Hide
          Chen He added a comment -

          Hi Cheolsoo Park,
          Thank you for assigning this to me.
          Yes, it is, I will link them together.

          Show
          Chen He added a comment - Hi Cheolsoo Park , Thank you for assigning this to me. Yes, it is, I will link them together.
          Hide
          Cheolsoo Park added a comment -

          This is great! Thank you for working on this.

          Btw, does this jira depends on TEZ-710? If so, can you link them together?

          Show
          Cheolsoo Park added a comment - This is great! Thank you for working on this. Btw, does this jira depends on TEZ-710 ? If so, can you link them together?

            People

            • Assignee:
              Chen He
              Reporter:
              Chen He
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development