Pig
  1. Pig
  2. PIG-3446 Umbrella jira for Pig on Tez
  3. PIG-3448

Tez backend layout

        Details

        • Type: Sub-task Sub-task
        • Status: Resolved
        • Priority: Major Major
        • Resolution: Fixed
        • Affects Version/s: tez-branch
        • Fix Version/s: tez-branch
        • Component/s: tez
        • Labels:
          None

          Description

          Design the high-level layout of Tez backend.

          1. Text File
            PIG-3448-3.patch
            35 kB
            Cheolsoo Park
          2. Text File
            PIG-3448-2.patch
            35 kB
            Cheolsoo Park
          3. Text File
            PIG-3448-1.patch
            37 kB
            Cheolsoo Park

            Issue Links

            requires

            Sub-task - The sub-task of the issue PIG-3471 Add a base abstract class for ExecutionEngine

            • Major - Major loss of function.
            • Resolved
            links to

            Web Link ReviewBoard

              Activity

              Descending order - Click to sort in ascending order
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Committed to tez branch.

              Show
              Cheolsoo Park added a comment - Committed to tez branch.
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Aniket Mokashi, thank you for taking a look.

              Regarding your comment on JVM heap size on unit test, I just found some unit test cases (e.g. TestPigServer) fail with OOM when running with Hadoop-2.1.0-beta so increased the heap size to keep my jenkins build happy for now.

              Show
              Cheolsoo Park added a comment - Aniket Mokashi , thank you for taking a look. Regarding your comment on JVM heap size on unit test, I just found some unit test cases (e.g. TestPigServer) fail with OOM when running with Hadoop-2.1.0-beta so increased the heap size to keep my jenkins build happy for now.
              Hide
              Permalink
              Aniket Mokashi added a comment -

              +1. LGTM. Thanks for doing this!

              Minor: This is just the skeleton code to enable Tez implementation and there are no tests added, why do we allocate more memory for unittests now, is that because of Tez/Yarn?

              Show
              Aniket Mokashi added a comment - +1. LGTM. Thanks for doing this! Minor: This is just the skeleton code to enable Tez implementation and there are no tests added, why do we allocate more memory for unittests now, is that because of Tez/Yarn?
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Minor clean ups. Note the latest patch depends on PIG-3471.

              Show
              Cheolsoo Park added a comment - Minor clean ups. Note the latest patch depends on PIG-3471 .
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Can I commit this into tez-branch? Or is someone going to give me a +1?

              Show
              Cheolsoo Park added a comment - Can I commit this into tez-branch? Or is someone going to give me a +1?
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Linking the RB url.

              Show
              Cheolsoo Park added a comment - Linking the RB url .
              Hide
              Permalink
              Cheolsoo Park added a comment -

              Uploading a first draft. The patch includes skeleton classes that I think we need to implement.

              Show
              Cheolsoo Park added a comment - Uploading a first draft. The patch includes skeleton classes that I think we need to implement.

                People

                • Assignee:
                  Cheolsoo Park
                  Reporter:
                  Cheolsoo Park
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development