Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: tez-branch
    • Component/s: tez
    • Labels:
      None

      Description

      Design the high-level layout of Tez backend.

      1. PIG-3448-3.patch
        35 kB
        Cheolsoo Park
      2. PIG-3448-2.patch
        35 kB
        Cheolsoo Park
      3. PIG-3448-1.patch
        37 kB
        Cheolsoo Park

        Issue Links

          Activity

          Hide
          Cheolsoo Park added a comment -

          Committed to tez branch.

          Show
          Cheolsoo Park added a comment - Committed to tez branch.
          Hide
          Cheolsoo Park added a comment -

          Aniket Mokashi, thank you for taking a look.

          Regarding your comment on JVM heap size on unit test, I just found some unit test cases (e.g. TestPigServer) fail with OOM when running with Hadoop-2.1.0-beta so increased the heap size to keep my jenkins build happy for now.

          Show
          Cheolsoo Park added a comment - Aniket Mokashi , thank you for taking a look. Regarding your comment on JVM heap size on unit test, I just found some unit test cases (e.g. TestPigServer) fail with OOM when running with Hadoop-2.1.0-beta so increased the heap size to keep my jenkins build happy for now.
          Hide
          Aniket Mokashi added a comment -

          +1. LGTM. Thanks for doing this!

          Minor: This is just the skeleton code to enable Tez implementation and there are no tests added, why do we allocate more memory for unittests now, is that because of Tez/Yarn?

          Show
          Aniket Mokashi added a comment - +1. LGTM. Thanks for doing this! Minor: This is just the skeleton code to enable Tez implementation and there are no tests added, why do we allocate more memory for unittests now, is that because of Tez/Yarn?
          Hide
          Cheolsoo Park added a comment -

          Minor clean ups. Note the latest patch depends on PIG-3471.

          Show
          Cheolsoo Park added a comment - Minor clean ups. Note the latest patch depends on PIG-3471 .
          Hide
          Cheolsoo Park added a comment -

          Can I commit this into tez-branch? Or is someone going to give me a +1?

          Show
          Cheolsoo Park added a comment - Can I commit this into tez-branch? Or is someone going to give me a +1?
          Hide
          Cheolsoo Park added a comment -

          Linking the RB url.

          Show
          Cheolsoo Park added a comment - Linking the RB url .
          Hide
          Cheolsoo Park added a comment -

          Uploading a first draft. The patch includes skeleton classes that I think we need to implement.

          Show
          Cheolsoo Park added a comment - Uploading a first draft. The patch includes skeleton classes that I think we need to implement.

            People

            • Assignee:
              Cheolsoo Park
              Reporter:
              Cheolsoo Park
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development