Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: 0.14.0
    • Component/s: tez
    • Labels:
      None

      Description

      This is a umbrella jira for Pig on Tez. More detailed subtasks will be added.

      More information can be found on the following wiki page:
      https://cwiki.apache.org/confluence/display/PIG/Pig+on+Tez

      How to set up your development environment-

      1. Check out Tez trunk.
      2. Install protobuf 2.5.0.
      3. Build Tez with Hadoop 2.2.0.(By default, it builds against Hadoop trunk, which is 3.0.0.)
      4. Install Tez jars on local maven repository with "mvn install -DskipTests".
      5. Check out Pig Tez branch.
      6. Build Pig running "ant jar-withouthadoop".
      7. Set up a single-node (or multi-node) Hadoop 2.2 cluster.
      8. Install Tez following the instructions on the Tez homepage.
      9. Run Pig with "-x tez" option.

      How to run Tez tests-

      • unit test
        ant test-tez
        

        By default, exectype is tez, and hadoopversion is 23 in tez branch. But you can run unit tests in mr mode as follows:

        ant test -Dexectype=mr -Dhadoopversion=20
        
      • e2e tests
        ant -Dharness.old.pig=$PIG_HOME -Dharness.hadoop.home=$HADOOP_HOME -Dharness.cluster.conf=$HADOOP_CONF -Dharness.cluster.bin=$HADOOP_BIN test-e2e-tez -Dhadoopversion=23
        

        Issue Links

        There are no Sub-Tasks for this issue.

          Activity

          Hide
          Julien Le Dem added a comment -

          Here is the work that Achal did for Pig-on-Tez
          https://github.com/achalsoni81/pigeon

          Show
          Julien Le Dem added a comment - Here is the work that Achal did for Pig-on-Tez https://github.com/achalsoni81/pigeon
          Hide
          Daniel Dai added a comment -

          Link this Jira to 0.15 since there are still several subproject is under progress.

          Show
          Daniel Dai added a comment - Link this Jira to 0.15 since there are still several subproject is under progress.
          Hide
          Daniel Dai added a comment -

          Resolve this ticket since the major work has completed in 0.14. New improvements and bug fix shall be separate Jiras.

          Show
          Daniel Dai added a comment - Resolve this ticket since the major work has completed in 0.14. New improvements and bug fix shall be separate Jiras.

            People

            • Assignee:
              Cheolsoo Park
              Reporter:
              Cheolsoo Park
            • Votes:
              0 Vote for this issue
              Watchers:
              29 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development