Hive
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7821

StarterProject: enable groupby4.q [Spark Branch]

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None
    1. HIVE-7821-spark.patch
      6 kB
      Brock Noland
    2. HIVE-7821.3-spark.patch
      6 kB
      Suhas Satish
    3. HIVE-7821.4-spark.patch
      6 kB
      Suhas Satish

      Activity

      Hide
      Brock Noland added a comment -

      Thank you so much Suhas! I have committed your patch to spark!

      Show
      Brock Noland added a comment - Thank you so much Suhas! I have committed your patch to spark!
      Hide
      Brock Noland added a comment -

      +1

      Thank you Suhas Satish!

      Show
      Brock Noland added a comment - +1 Thank you Suhas Satish !
      Hide
      Hive QA added a comment -

      Overall: -1 at least one tests failed

      Here are the results of testing the latest attachment:
      https://issues.apache.org/jira/secure/attachment/12663812/HIVE-7821.4-spark.patch

      ERROR: -1 due to 3 failed/errored test(s), 5996 tests executed
      Failed tests:

      org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
      org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
      org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
      

      Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/87/testReport
      Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/87/console
      Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-87/

      Messages:

      Executing org.apache.hive.ptest.execution.PrepPhase
      Executing org.apache.hive.ptest.execution.ExecutionPhase
      Executing org.apache.hive.ptest.execution.ReportingPhase
      Tests exited with: TestsFailedException: 3 tests failed
      

      This message is automatically generated.

      ATTACHMENT ID: 12663812

      Show
      Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663812/HIVE-7821.4-spark.patch ERROR: -1 due to 3 failed/errored test(s), 5996 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/87/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/87/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-87/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 3 tests failed This message is automatically generated. ATTACHMENT ID: 12663812
      Hide
      Suhas Satish added a comment -

      4 of the 5 tests are unrelated to SparkCliDriver.

      1 relevant failure groupby4.q.out had a SORT_BEFORE_DIFF from an experimental run.
      Attaching a clean one without it.

      Show
      Suhas Satish added a comment - 4 of the 5 tests are unrelated to SparkCliDriver. 1 relevant failure groupby4.q.out had a SORT_BEFORE_DIFF from an experimental run. Attaching a clean one without it.
      Hide
      Hive QA added a comment -

      Overall: -1 at least one tests failed

      Here are the results of testing the latest attachment:
      https://issues.apache.org/jira/secure/attachment/12663782/HIVE-7821.3-spark.patch

      ERROR: -1 due to 5 failed/errored test(s), 5996 tests executed
      Failed tests:

      org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook
      org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization
      org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2
      org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby4
      org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
      

      Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/83/testReport
      Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/83/console
      Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-83/

      Messages:

      Executing org.apache.hive.ptest.execution.PrepPhase
      Executing org.apache.hive.ptest.execution.ExecutionPhase
      Executing org.apache.hive.ptest.execution.ReportingPhase
      Tests exited with: TestsFailedException: 5 tests failed
      

      This message is automatically generated.

      ATTACHMENT ID: 12663782

      Show
      Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663782/HIVE-7821.3-spark.patch ERROR: -1 due to 5 failed/errored test(s), 5996 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample_islocalmode_hook org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_opt_vectorization org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_fs_default_name2 org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver_groupby4 org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/83/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/83/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-83/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed This message is automatically generated. ATTACHMENT ID: 12663782
      Hide
      Suhas Satish added a comment -

      rebasing patch

      Show
      Suhas Satish added a comment - rebasing patch
      Hide
      Hive QA added a comment -

      Overall: -1 no tests executed

      Here are the results of testing the latest attachment:
      https://issues.apache.org/jira/secure/attachment/12663741/HIVE-7821.2-spark.patch

      Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/82/testReport
      Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/82/console
      Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-82/

      Messages:

      Executing org.apache.hive.ptest.execution.PrepPhase
      Tests exited with: NonZeroExitCodeException
      Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
      + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
      + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
      + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
      + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
      + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
      + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
      + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
      + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
      + cd /data/hive-ptest/working/
      + tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-82/source-prep.txt
      + [[ false == \t\r\u\e ]]
      + mkdir -p maven ivy
      + [[ svn = \s\v\n ]]
      + [[ -n '' ]]
      + [[ -d apache-svn-spark-source ]]
      + [[ ! -d apache-svn-spark-source/.svn ]]
      + [[ ! -d apache-svn-spark-source ]]
      + cd apache-svn-spark-source
      + svn revert -R .
      ++ svn status --no-ignore
      ++ egrep -v '^X|^Performing status on external'
      ++ awk '{print $2}'
      + rm -rf
      + svn update
      A    ql/src/test/results/clientpositive/spark/having.q.out
      A    ql/src/test/results/clientpositive/spark/groupby1.q.out
      A    ql/src/test/results/clientpositive/spark/groupby3.q.out
      A    ql/src/test/results/clientpositive/spark/insert_into1.q.out
      A    ql/src/test/results/clientpositive/spark/insert1.q.out
      A    ql/src/test/results/clientpositive/spark/groupby2.q.out
      A    ql/src/test/results/clientpositive/spark/enforce_order.q.out
      A    ql/src/test/results/clientpositive/spark/insert_into2.q.out
      U    itests/src/test/resources/testconfiguration.properties
      
      Fetching external item into 'hcatalog/src/test/e2e/harness'
      Updated external to revision 1619932.
      
      Updated to revision 1619932.
      + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
      + patchFilePath=/data/hive-ptest/working/scratch/build.patch
      + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
      + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
      + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
      The patch does not appear to apply with p0, p1, or p2
      + exit 1
      '
      

      This message is automatically generated.

      ATTACHMENT ID: 12663741

      Show
      Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663741/HIVE-7821.2-spark.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/82/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/82/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-82/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]] + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-82/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-spark-source ]] + [[ ! -d apache-svn-spark-source/.svn ]] + [[ ! -d apache-svn-spark-source ]] + cd apache-svn-spark-source + svn revert -R . ++ svn status --no-ignore ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' + rm -rf + svn update A ql/src/test/results/clientpositive/spark/having.q.out A ql/src/test/results/clientpositive/spark/groupby1.q.out A ql/src/test/results/clientpositive/spark/groupby3.q.out A ql/src/test/results/clientpositive/spark/insert_into1.q.out A ql/src/test/results/clientpositive/spark/insert1.q.out A ql/src/test/results/clientpositive/spark/groupby2.q.out A ql/src/test/results/clientpositive/spark/enforce_order.q.out A ql/src/test/results/clientpositive/spark/insert_into2.q.out U itests/src/test/resources/testconfiguration.properties Fetching external item into 'hcatalog/src/test/e2e/harness' Updated external to revision 1619932. Updated to revision 1619932. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12663741
      Hide
      Suhas Satish added a comment -

      Attached updated patch generated with git diff --no-prefix

      Show
      Suhas Satish added a comment - Attached updated patch generated with git diff --no-prefix
      Hide
      Hive QA added a comment -

      Overall: -1 no tests executed

      Here are the results of testing the latest attachment:
      https://issues.apache.org/jira/secure/attachment/12663717/HIVE-7821-spark.patch

      Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/81/testReport
      Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/81/console
      Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-81/

      Messages:

      Executing org.apache.hive.ptest.execution.PrepPhase
      Tests exited with: NonZeroExitCodeException
      Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
      + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
      + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
      + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
      + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
      + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
      + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
      + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
      + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
      + cd /data/hive-ptest/working/
      + tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-81/source-prep.txt
      + [[ false == \t\r\u\e ]]
      + mkdir -p maven ivy
      + [[ svn = \s\v\n ]]
      + [[ -n '' ]]
      + [[ -d apache-svn-spark-source ]]
      + [[ ! -d apache-svn-spark-source/.svn ]]
      + [[ ! -d apache-svn-spark-source ]]
      + cd apache-svn-spark-source
      + svn revert -R .
      Reverted 'common/src/java/org/apache/hadoop/hive/conf/HiveConf.java'
      Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionImpl.java'
      Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java'
      Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java'
      ++ svn status --no-ignore
      ++ egrep -v '^X|^Performing status on external'
      ++ awk '{print $2}'
      + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target cli/target odbc/target ql/dependency-reduced-pom.xml ql/target
      + svn update
      U    itests/src/test/resources/testconfiguration.properties
      A    ql/src/test/results/clientpositive/spark/order2.q.out
      A    ql/src/test/results/clientpositive/spark/escape_clusterby1.q.out
      A    ql/src/test/results/clientpositive/spark/sort.q.out
      A    ql/src/test/results/clientpositive/spark/order.q.out
      A    ql/src/test/results/clientpositive/spark/escape_sortby1.q.out
      A    ql/src/test/results/clientpositive/spark/escape_orderby1.q.out
      A    ql/src/test/results/clientpositive/spark/escape_distributeby1.q.out
      
      Fetching external item into 'hcatalog/src/test/e2e/harness'
      Updated external to revision 1619916.
      
      Updated to revision 1619916.
      + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
      + patchFilePath=/data/hive-ptest/working/scratch/build.patch
      + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
      + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
      + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
      The patch does not appear to apply with p0, p1, or p2
      + exit 1
      '
      

      This message is automatically generated.

      ATTACHMENT ID: 12663717

      Show
      Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12663717/HIVE-7821-spark.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/81/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-SPARK-Build/81/console Test logs: http://ec2-54-176-176-199.us-west-1.compute.amazonaws.com/logs/PreCommit-HIVE-SPARK-Build-81/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]] + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-maven-3.0.5/bin:/usr/lib64/qt-3.3/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.7.0_45-cloudera/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-SPARK-Build-81/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-spark-source ]] + [[ ! -d apache-svn-spark-source/.svn ]] + [[ ! -d apache-svn-spark-source ]] + cd apache-svn-spark-source + svn revert -R . Reverted 'common/src/java/org/apache/hadoop/hive/conf/HiveConf.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/session/SparkSessionImpl.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkTask.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkClient.java' ++ svn status --no-ignore ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit-hadoop2/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/qtest-spark/target hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/hcatalog-pig-adapter/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target cli/target odbc/target ql/dependency-reduced-pom.xml ql/target + svn update U itests/src/test/resources/testconfiguration.properties A ql/src/test/results/clientpositive/spark/order2.q.out A ql/src/test/results/clientpositive/spark/escape_clusterby1.q.out A ql/src/test/results/clientpositive/spark/sort.q.out A ql/src/test/results/clientpositive/spark/order.q.out A ql/src/test/results/clientpositive/spark/escape_sortby1.q.out A ql/src/test/results/clientpositive/spark/escape_orderby1.q.out A ql/src/test/results/clientpositive/spark/escape_distributeby1.q.out Fetching external item into 'hcatalog/src/test/e2e/harness' Updated external to revision 1619916. Updated to revision 1619916. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12663717
      Hide
      Brock Noland added a comment -

      Thank you Suhas! I have renamed your patch so the spark branch unit tests will run against it.

      Show
      Brock Noland added a comment - Thank you Suhas! I have renamed your patch so the spark branch unit tests will run against it.
      Hide
      Brock Noland added a comment -

      Same patch under a different name

      Show
      Brock Noland added a comment - Same patch under a different name
      Hide
      Suhas Satish added a comment -

      grouby4 has a deterministic order, so the output ordering when run on spark is the same across test runs, but may not match the same order as q.out from corresponding test run on map-reduce.

      Show
      Suhas Satish added a comment - grouby4 has a deterministic order, so the output ordering when run on spark is the same across test runs, but may not match the same order as q.out from corresponding test run on map-reduce.
      Hide
      Brock Noland added a comment -

      Gotcha! Sounds good! Just leave groupby4.q out of your other work! Cheers

      Show
      Brock Noland added a comment - Gotcha! Sounds good! Just leave groupby4.q out of your other work! Cheers
      Hide
      Chinna Rao Lalam added a comment -

      Hi Brock Noland,

      I don't know you have created for suhas. I am handling group by queries in the previous jira so i assigned my self to avoid duplicate work.
      I don't mind let Suhas can work on this.

      Show
      Chinna Rao Lalam added a comment - Hi Brock Noland , I don't know you have created for suhas. I am handling group by queries in the previous jira so i assigned my self to avoid duplicate work. I don't mind let Suhas can work on this.
      Hide
      Brock Noland added a comment -

      Hi Chinna Rao Lalam just an FYI that HIVE-7793 is available!

      Show
      Brock Noland added a comment - Hi Chinna Rao Lalam just an FYI that HIVE-7793 is available!
      Hide
      Brock Noland added a comment -

      Hi Chinna Rao Lalam,

      Thank you for picking this up! I should have mentioned, I created this one for Suhas who has recently joined the project team. Would you mind if he takes this one?

      Show
      Brock Noland added a comment - Hi Chinna Rao Lalam , Thank you for picking this up! I should have mentioned, I created this one for Suhas who has recently joined the project team. Would you mind if he takes this one?

        People

        • Assignee:
          Suhas Satish
          Reporter:
          Brock Noland
        • Votes:
          0 Vote for this issue
          Watchers:
          3 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development