Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: tez-branch
    • Fix Version/s: 0.13.0, 0.14.0
    • Component/s: Tez
    • Labels:
      None

      Description

      Support bucket map joins in tez.

      1. HIVE-6447.WIP.patch
        71 kB
        Vikram Dixit K
      2. HIVE-6447.9.patch
        231 kB
        Vikram Dixit K
      3. HIVE-6447.8.patch
        214 kB
        Vikram Dixit K
      4. HIVE-6447.7.patch
        214 kB
        Vikram Dixit K
      5. HIVE-6447.6.patch
        184 kB
        Vikram Dixit K
      6. HIVE-6447.5.patch
        181 kB
        Vikram Dixit K
      7. HIVE-6447.4.patch
        125 kB
        Vikram Dixit K
      8. HIVE-6447.3.patch
        120 kB
        Vikram Dixit K
      9. HIVE-6447.2.patch
        117 kB
        Vikram Dixit K
      10. HIVE-6447.13.patch
        233 kB
        Vikram Dixit K
      11. HIVE-6447.12.patch
        232 kB
        Vikram Dixit K
      12. HIVE-6447.11.patch
        232 kB
        Vikram Dixit K
      13. HIVE-6447.10.patch
        231 kB
        Vikram Dixit K
      14. HIVE-6447.1.patch
        141 kB
        Vikram Dixit K

        Issue Links

          Activity

          Vikram Dixit K created issue -
          Vikram Dixit K made changes -
          Field Original Value New Value
          Attachment HIVE-6447.WIP.patch [ 12629364 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Vikram Dixit K added a comment -

          Cannot create a review request at this time for some reason. Will try again and update the jira.

          Show
          Vikram Dixit K added a comment - Cannot create a review request at this time for some reason. Will try again and update the jira.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.WIP.patch [ 12629364 ]
          Hide
          Vikram Dixit K added a comment -

          Wrong file.

          Show
          Vikram Dixit K added a comment - Wrong file.
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.WIP.patch [ 12629493 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.WIP.patch [ 12629493 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.WIP.patch [ 12629495 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.1.patch [ 12633780 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.1.patch [ 12633780 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.1.patch [ 12633788 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Vikram Dixit K added a comment -

          Updated golden test file results and minor changes.

          Show
          Vikram Dixit K added a comment - Updated golden test file results and minor changes.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.2.patch [ 12633855 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vikram Dixit K made changes -
          Remote Link This issue links to "review board (Web Link)" [ 14540 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12633855/HIVE-6447.2.patch

          ERROR: -1 due to 7 failed/errored test(s), 5387 tests executed
          Failed tests:

          org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testBuildDag
          org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testClose
          org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testEmptyWork
          org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testSubmit
          org.apache.hadoop.hive.ql.plan.TestTezWork.testBroadcastConnect
          org.apache.hadoop.hive.ql.plan.TestTezWork.testConnect
          org.apache.hive.service.cli.TestEmbeddedThriftBinaryCLIService.testExecuteStatementAsync
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 7 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12633855

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12633855/HIVE-6447.2.patch ERROR: -1 due to 7 failed/errored test(s), 5387 tests executed Failed tests: org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testBuildDag org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testClose org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testEmptyWork org.apache.hadoop.hive.ql.exec.tez.TestTezTask.testSubmit org.apache.hadoop.hive.ql.plan.TestTezWork.testBroadcastConnect org.apache.hadoop.hive.ql.plan.TestTezWork.testConnect org.apache.hive.service.cli.TestEmbeddedThriftBinaryCLIService.testExecuteStatementAsync Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1714/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed This message is automatically generated. ATTACHMENT ID: 12633855
          Hide
          Vikram Dixit K added a comment -

          Address failing tests.

          Show
          Vikram Dixit K added a comment - Address failing tests.
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Vikram Dixit K added a comment -

          Fix failing tests.

          Show
          Vikram Dixit K added a comment - Fix failing tests.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.3.patch [ 12634499 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12634499/HIVE-6447.3.patch

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Tests exited with: NonZeroExitCodeException
          Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]]
          + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
          + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
          + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + cd /data/hive-ptest/working/
          + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1823/source-prep.txt
          + [[ false == \t\r\u\e ]]
          + mkdir -p maven ivy
          + [[ svn = \s\v\n ]]
          + [[ -n '' ]]
          + [[ -d apache-svn-trunk-source ]]
          + [[ ! -d apache-svn-trunk-source/.svn ]]
          + [[ ! -d apache-svn-trunk-source ]]
          + cd apache-svn-trunk-source
          + svn revert -R .
          ++ egrep -v '^X|^Performing status on external'
          ++ awk '{print $2}'
          ++ svn status --no-ignore
          + rm -rf
          + svn update
          
          Fetching external item into 'hcatalog/src/test/e2e/harness'
          External at revision 1577820.
          
          At revision 1577820.
          + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
          + patchFilePath=/data/hive-ptest/working/scratch/build.patch
          + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
          + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
          + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
          The patch does not appear to apply with p0, p1, or p2
          + exit 1
          '
          

          This message is automatically generated.

          ATTACHMENT ID: 12634499

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12634499/HIVE-6447.3.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1823/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]] + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1823/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' ++ svn status --no-ignore + rm -rf + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1577820. At revision 1577820. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12634499
          Vikram Dixit K made changes -
          Attachment HIVE-6447.4.patch [ 12635732 ]
          Hide
          Vikram Dixit K added a comment -

          Address review comments.

          Show
          Vikram Dixit K added a comment - Address review comments.
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hive QA added a comment -

          Overall: +1 all checks pass

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12635732/HIVE-6447.4.patch

          SUCCESS: +1 5440 tests passed

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          

          This message is automatically generated.

          ATTACHMENT ID: 12635732

          Show
          Hive QA added a comment - Overall : +1 all checks pass Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12635732/HIVE-6447.4.patch SUCCESS: +1 5440 tests passed Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1921/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase This message is automatically generated. ATTACHMENT ID: 12635732
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Vikram Dixit K added a comment -

          Addressed review comments.

          Show
          Vikram Dixit K added a comment - Addressed review comments.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.5.patch [ 12636307 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.5.patch [ 12636307 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.5.patch [ 12636317 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Vikram Dixit K added a comment -

          Address review comments.

          Show
          Vikram Dixit K added a comment - Address review comments.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.6.patch [ 12636519 ]
          Hide
          Siddharth Seth added a comment -

          The tez side of things in the CustomEdge and CustomVertex look good. +1. Left some minor comments.

          Show
          Siddharth Seth added a comment - The tez side of things in the CustomEdge and CustomVertex look good. +1. Left some minor comments.
          Hide
          Vikram Dixit K added a comment -

          Address Harish and Sid's comments.

          Show
          Vikram Dixit K added a comment - Address Harish and Sid's comments.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.7.patch [ 12636662 ]
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.8.patch [ 12636729 ]
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Vikram Dixit K added a comment -

          More tests added and some minor fixes.

          Show
          Vikram Dixit K added a comment - More tests added and some minor fixes.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.9.patch [ 12636799 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Harish Butani added a comment -

          lgtm, +1 for the traits propagation and Join conversion pieces.

          Show
          Harish Butani added a comment - lgtm, +1 for the traits propagation and Join conversion pieces.
          Hide
          Vikram Dixit K added a comment -

          During run-time, there is an error without setting up the edge property correctly in the "sub-query as big table" case.

          Show
          Vikram Dixit K added a comment - During run-time, there is an error without setting up the edge property correctly in the "sub-query as big table" case.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.10.patch [ 12636844 ]
          Hide
          Alan Gates added a comment -

          Saw following failures when running tests:
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt5
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt6
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt7
          2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt8

          Show
          Alan Gates added a comment - Saw following failures when running tests: 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt5 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt6 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt7 2014-03-26 02:40:03 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt8
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12636844/HIVE-6447.10.patch

          ERROR: -1 due to 49 failed/errored test(s), 5457 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt5
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt6
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt7
          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt8
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucket5
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6
          org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 49 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12636844

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12636844/HIVE-6447.10.patch ERROR: -1 due to 49 failed/errored test(s), 5457 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer11 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer15 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_correlationoptimizer9 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_innerjoin org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input33 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_into3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_lateral_view org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_limit_pushdown_negative org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_mapreduce8 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multiMapJoin2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_multi_insert_gby org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_quotedid_skew org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt1 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt10 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt11 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt12 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt14 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt15 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt16 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt17 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt19 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt2 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt20 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt3 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt5 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt6 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt7 org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt8 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucket5 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucketmapjoin6 org.apache.hive.service.cli.thrift.TestThriftHttpCLIService.testExecuteStatementAsync Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1965/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 49 tests failed This message is automatically generated. ATTACHMENT ID: 12636844
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Vikram Dixit K added a comment -

          Fix failing tests.

          Show
          Vikram Dixit K added a comment - Fix failing tests.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.11.patch [ 12637003 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Vikram Dixit K made changes -
          Attachment HIVE-6447.12.patch [ 12637022 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12637022/HIVE-6447.12.patch

          ERROR: -1 due to 2 failed/errored test(s), 5491 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby
          org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12637022

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12637022/HIVE-6447.12.patch ERROR: -1 due to 2 failed/errored test(s), 5491 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby org.apache.hadoop.hive.cli.TestNegativeMinimrCliDriver.testNegativeCliDriver_mapreduce_stack_trace_hadoop20 Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1974/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12637022
          Hide
          Vikram Dixit K added a comment -

          Failures unrelated. They pass locally.

          Show
          Vikram Dixit K added a comment - Failures unrelated. They pass locally.
          Hide
          Vikram Dixit K added a comment -

          Fix for final stage reducer having no #reducer settings.

          Show
          Vikram Dixit K added a comment - Fix for final stage reducer having no #reducer settings.
          Vikram Dixit K made changes -
          Attachment HIVE-6447.13.patch [ 12637287 ]
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Vikram Dixit K made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Harish Butani added a comment -

          +1 for 0.13

          Show
          Harish Butani added a comment - +1 for 0.13
          Hide
          Thejas M Nair added a comment -

          Ran tests in my setup and the tests passed.

          Show
          Thejas M Nair added a comment - Ran tests in my setup and the tests passed.
          Hide
          Vikram Dixit K added a comment -

          Committed to trunk and branch-0.13. Thanks for the reviews Siddharth Seth, Gunther Hagleitner, Harish Butani. Thanks Alan Gates Thejas M Nair for the test runs.

          Show
          Vikram Dixit K added a comment - Committed to trunk and branch-0.13. Thanks for the reviews Siddharth Seth , Gunther Hagleitner , Harish Butani . Thanks Alan Gates Thejas M Nair for the test runs.
          Vikram Dixit K made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.13.0 [ 12324986 ]
          Fix Version/s 0.14.0 [ 12326450 ]
          Resolution Fixed [ 1 ]
          Hide
          Lefty Leverenz added a comment -

          This adds hive.convert.join.bucket.mapjoin.tez to HiveConf.java without a description. If you write a release note and include the description, I'll put it in the wiki and make sure it's added to the new HiveConf.java & hive-default.xml.template via HIVE-6586 after HIVE-6037 gets committed.

          Show
          Lefty Leverenz added a comment - This adds hive.convert.join.bucket.mapjoin.tez to HiveConf.java without a description. If you write a release note and include the description, I'll put it in the wiki and make sure it's added to the new HiveConf.java & hive-default.xml.template via HIVE-6586 after HIVE-6037 gets committed.
          Hide
          Vikram Dixit K added a comment -

          Hi Lefty,

          This would be the change to the template file:

          <property>
            <name>hive.convert.join.bucket.mapjoin.tez</name>
            <value>false</value>
            <description>Whether joins can be automatically converted to bucket map joins in hive when tez is used as the execution engine.</description>
          </property>
          

          Thanks
          Vikram.

          Show
          Vikram Dixit K added a comment - Hi Lefty, This would be the change to the template file: <property> <name>hive.convert.join.bucket.mapjoin.tez</name> <value> false </value> <description>Whether joins can be automatically converted to bucket map joins in hive when tez is used as the execution engine.</description> </property> Thanks Vikram.
          Hide
          Chris Drome added a comment -

          A method call in ql/src/java/org/apache/hadoop/hive/ql/exec/tez/CustomPartitionVertex.java is mispelled causing a compilation failure when building against Hadoop-2.x.

          Line 681 of the patch is:

          + int totalResource = context.getTotalAVailableResource().getMemory();

          but should be:

          + int totalResource = context.getTotalAvailableResource().getMemory();

          Show
          Chris Drome added a comment - A method call in ql/src/java/org/apache/hadoop/hive/ql/exec/tez/CustomPartitionVertex.java is mispelled causing a compilation failure when building against Hadoop-2.x. Line 681 of the patch is: + int totalResource = context.getTotalAVailableResource().getMemory(); but should be: + int totalResource = context.getTotalAvailableResource().getMemory();
          Hide
          Vikram Dixit K added a comment -

          Hi Chris,

          I completely cleaned my .m2 and built this and it passes. I think the tez folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond. Hive is currently dependent on 0.4.0-incubating only. This works with that version of tez.

          Thanks
          Vikram.

          Show
          Vikram Dixit K added a comment - Hi Chris, I completely cleaned my .m2 and built this and it passes. I think the tez folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond. Hive is currently dependent on 0.4.0-incubating only. This works with that version of tez. Thanks Vikram.
          Hide
          Vikram Dixit K added a comment -

          Hi Chris,

          I completely cleaned my .m2 and built this and it passes. I think the tez
          folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond.
          Hive is currently dependent on 0.4.0-incubating only. This works with that
          version of tez.

          Thanks
          Vikram.


          Nothing better than when appreciated for hard work.
          -Mark

          Show
          Vikram Dixit K added a comment - Hi Chris, I completely cleaned my .m2 and built this and it passes. I think the tez folks fixed this spelling issue in 0.4.0-incubating-SNAPSHOT and beyond. Hive is currently dependent on 0.4.0-incubating only. This works with that version of tez. Thanks Vikram. – Nothing better than when appreciated for hard work. -Mark
          Hide
          Chris Drome added a comment -

          Thanks for the clarification. We are using a newer version of Tez, which caused the problem.

          Show
          Chris Drome added a comment - Thanks for the clarification. We are using a newer version of Tez, which caused the problem.
          Hide
          Lefty Leverenz added a comment -

          hive.convert.join.bucket.mapjoin.tez is documented in the wiki here:

          Show
          Lefty Leverenz added a comment - hive.convert.join.bucket.mapjoin.tez is documented in the wiki here: Configuration Properties – Tez – hive.convert.join.bucket.mapjoin.tez
          Hide
          Thejas M Nair added a comment -

          This has been fixed in 0.14 release. Please open new jira if you see any issues.

          Show
          Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.
          Thejas M Nair made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Vikram Dixit K
              Reporter:
              Vikram Dixit K
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development