Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None

      Description

      TezJobControlCompiler converts tez plan into tez DAG. Once tez DAG is built, it is wrapped by JobControl before being submitted by TezLauncher.

      1. PIG-3501-1.patch
        25 kB
        Cheolsoo Park
      2. PIG-3501-2.patch
        31 kB
        Cheolsoo Park
      3. PIG-3501-3.patch
        36 kB
        Cheolsoo Park

        Issue Links

          Activity

          Hide
          Cheolsoo Park added a comment -

          Committed to tez branch.

          Show
          Cheolsoo Park added a comment - Committed to tez branch.
          Hide
          Cheolsoo Park added a comment -

          Thank you Mark! The new patch includes all your suggestions.

          Show
          Cheolsoo Park added a comment - Thank you Mark! The new patch includes all your suggestions.
          Hide
          Mark Wagner added a comment -

          I left a couple of small comments on the RB, but this looks almost ready.

          Show
          Mark Wagner added a comment - I left a couple of small comments on the RB, but this looks almost ready.
          Hide
          Cheolsoo Park added a comment -
          Show
          Cheolsoo Park added a comment - ReviewBoard: https://reviews.apache.org/r/14505/
          Hide
          Cheolsoo Park added a comment -

          Note the patch should be applied after PIG-3500 (TezCompiler).

          Show
          Cheolsoo Park added a comment - Note the patch should be applied after PIG-3500 (TezCompiler).
          Hide
          Cheolsoo Park added a comment -

          Attached includes an initial version of TezJobControlCompiler with unit tests. Tez DAG is built by TezDagBuilder which is an extension of TezOpPlanVisitor.

          The unit tests can run with ant clean test -Dtestcase=TestTezJobControlCompiler.

          Show
          Cheolsoo Park added a comment - Attached includes an initial version of TezJobControlCompiler with unit tests. Tez DAG is built by TezDagBuilder which is an extension of TezOpPlanVisitor. The unit tests can run with ant clean test -Dtestcase=TestTezJobControlCompiler.

            People

            • Assignee:
              Cheolsoo Park
              Reporter:
              Cheolsoo Park
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development