Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Spark
    • None

    Description

      The Spark community is in the process of releasing Spark 2.4.0. We should do some testing with the RC candidates and then upgrade once the release is finalized.

      Attachments

        1. HIVE-20828.1.patch
          1 kB
          Sahil Takiar
        2. HIVE-20828.2.patch
          2 kB
          Sahil Takiar

        Activity

          hiveqa Hive QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                master Compile Tests
          0 mvndep 1m 22s Maven dependency ordering for branch
          +1 mvninstall 6m 53s master passed
          +1 compile 5m 52s master passed
          +1 javadoc 6m 15s master passed
                Patch Compile Tests
          0 mvndep 0m 30s Maven dependency ordering for patch
          +1 mvninstall 6m 21s the patch passed
          +1 compile 5m 35s the patch passed
          +1 javac 5m 35s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 1s The patch has no ill-formed XML file.
          +1 javadoc 6m 12s the patch passed
                Other Tests
          +1 asflicense 0m 11s The patch does not generate ASF License warnings.
          39m 34s



          Subsystem Report/Notes
          Optional Tests asflicense javac javadoc xml compile
          uname Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux
          Build tool maven
          Personality /data/hiveptest/working/yetus_PreCommit-HIVE-Build-15087/dev-support/hive-personality.sh
          git revision master / 56926af
          Default Java 1.8.0_111
          modules C: . itests U: .
          Console output http://104.198.109.242/logs//PreCommit-HIVE-Build-15087/yetus.txt
          Powered by Apache Yetus http://yetus.apache.org

          This message was automatically generated.

          hiveqa Hive QA added a comment - +1 overall Vote Subsystem Runtime Comment       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       master Compile Tests 0 mvndep 1m 22s Maven dependency ordering for branch +1 mvninstall 6m 53s master passed +1 compile 5m 52s master passed +1 javadoc 6m 15s master passed       Patch Compile Tests 0 mvndep 0m 30s Maven dependency ordering for patch +1 mvninstall 6m 21s the patch passed +1 compile 5m 35s the patch passed +1 javac 5m 35s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 1s The patch has no ill-formed XML file. +1 javadoc 6m 12s the patch passed       Other Tests +1 asflicense 0m 11s The patch does not generate ASF License warnings. 39m 34s Subsystem Report/Notes Optional Tests asflicense javac javadoc xml compile uname Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux Build tool maven Personality /data/hiveptest/working/yetus_PreCommit-HIVE-Build-15087/dev-support/hive-personality.sh git revision master / 56926af Default Java 1.8.0_111 modules C: . itests U: . Console output http://104.198.109.242/logs//PreCommit-HIVE-Build-15087/yetus.txt Powered by Apache Yetus http://yetus.apache.org This message was automatically generated.
          hiveqa Hive QA added a comment -

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12949763/HIVE-20828.2.patch

          ERROR: -1 due to no test(s) being added or modified.

          ERROR: -1 due to 5 failed/errored test(s), 15546 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestLocalSparkCliDriver.testCliDriver[spark_local_queries] (batchId=275)
          org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_cores] (batchId=275)
          org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_memory] (batchId=275)
          org.apache.hadoop.hive.ql.exec.spark.TestSparkInvalidFileFormat.readTextFileAsParquet (batchId=317)
          org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSessionSparkSessionTimeout (batchId=253)
          

          Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/15087/testReport
          Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/15087/console
          Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-15087/

          Messages:

          Executing org.apache.hive.ptest.execution.TestCheckPhase
          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.YetusPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 5 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12949763 - PreCommit-HIVE-Build

          hiveqa Hive QA added a comment - Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12949763/HIVE-20828.2.patch ERROR: -1 due to no test(s) being added or modified. ERROR: -1 due to 5 failed/errored test(s), 15546 tests executed Failed tests: org.apache.hadoop.hive.cli.TestLocalSparkCliDriver.testCliDriver[spark_local_queries] (batchId=275) org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_cores] (batchId=275) org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_memory] (batchId=275) org.apache.hadoop.hive.ql.exec.spark.TestSparkInvalidFileFormat.readTextFileAsParquet (batchId=317) org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSessionSparkSessionTimeout (batchId=253) Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/15087/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/15087/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-15087/ Messages: Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 5 tests failed This message is automatically generated. ATTACHMENT ID: 12949763 - PreCommit-HIVE-Build
          toopt4 t oo added a comment -

          upg to spark 2.4.1?

          toopt4 t oo added a comment - upg to spark 2.4.1?
          hiveqa Hive QA added a comment -
          +1 overall



          Vote Subsystem Runtime Comment
                Prechecks
          +1 @author 0m 0s The patch does not contain any @author tags.
                master Compile Tests
          0 mvndep 1m 50s Maven dependency ordering for branch
          +1 mvninstall 7m 26s master passed
          +1 compile 6m 39s master passed
          +1 javadoc 7m 14s master passed
                Patch Compile Tests
          0 mvndep 0m 28s Maven dependency ordering for patch
          +1 mvninstall 7m 2s the patch passed
          +1 compile 6m 27s the patch passed
          +1 javac 6m 27s the patch passed
          +1 whitespace 0m 0s The patch has no whitespace issues.
          +1 xml 0m 4s The patch has no ill-formed XML file.
          +1 javadoc 7m 12s the patch passed
                Other Tests
          +1 asflicense 0m 12s The patch does not generate ASF License warnings.
          44m 56s



          Subsystem Report/Notes
          Optional Tests asflicense javac javadoc xml compile
          uname Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux
          Build tool maven
          Personality /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16213/dev-support/hive-personality.sh
          git revision master / 69a7fc5
          Default Java 1.8.0_111
          modules C: . itests U: .
          Console output http://104.198.109.242/logs//PreCommit-HIVE-Build-16213/yetus.txt
          Powered by Apache Yetus http://yetus.apache.org

          This message was automatically generated.

          hiveqa Hive QA added a comment - +1 overall Vote Subsystem Runtime Comment       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       master Compile Tests 0 mvndep 1m 50s Maven dependency ordering for branch +1 mvninstall 7m 26s master passed +1 compile 6m 39s master passed +1 javadoc 7m 14s master passed       Patch Compile Tests 0 mvndep 0m 28s Maven dependency ordering for patch +1 mvninstall 7m 2s the patch passed +1 compile 6m 27s the patch passed +1 javac 6m 27s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues. +1 xml 0m 4s The patch has no ill-formed XML file. +1 javadoc 7m 12s the patch passed       Other Tests +1 asflicense 0m 12s The patch does not generate ASF License warnings. 44m 56s Subsystem Report/Notes Optional Tests asflicense javac javadoc xml compile uname Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u1 (2016-09-03) x86_64 GNU/Linux Build tool maven Personality /data/hiveptest/working/yetus_PreCommit-HIVE-Build-16213/dev-support/hive-personality.sh git revision master / 69a7fc5 Default Java 1.8.0_111 modules C: . itests U: . Console output http://104.198.109.242/logs//PreCommit-HIVE-Build-16213/yetus.txt Powered by Apache Yetus http://yetus.apache.org This message was automatically generated.
          hiveqa Hive QA added a comment -

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12949763/HIVE-20828.2.patch

          ERROR: -1 due to no test(s) being added or modified.

          ERROR: -1 due to 6 failed/errored test(s), 15811 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestLocalSparkCliDriver.testCliDriver[spark_local_queries] (batchId=277)
          org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_cores] (batchId=277)
          org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_memory] (batchId=277)
          org.apache.hadoop.hive.ql.exec.spark.TestSmallTableCacheEviction.testSmallTableEvictionIfNewQueryIsExecuted (batchId=254)
          org.apache.hadoop.hive.ql.exec.spark.TestSparkInvalidFileFormat.readTextFileAsParquet (batchId=320)
          org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSessionSparkSessionTimeout (batchId=254)
          

          Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16213/testReport
          Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16213/console
          Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16213/

          Messages:

          Executing org.apache.hive.ptest.execution.TestCheckPhase
          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.YetusPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 6 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12949763 - PreCommit-HIVE-Build

          hiveqa Hive QA added a comment - Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12949763/HIVE-20828.2.patch ERROR: -1 due to no test(s) being added or modified. ERROR: -1 due to 6 failed/errored test(s), 15811 tests executed Failed tests: org.apache.hadoop.hive.cli.TestLocalSparkCliDriver.testCliDriver[spark_local_queries] (batchId=277) org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_cores] (batchId=277) org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.testCliDriver[spark_submit_negative_executor_memory] (batchId=277) org.apache.hadoop.hive.ql.exec.spark.TestSmallTableCacheEviction.testSmallTableEvictionIfNewQueryIsExecuted (batchId=254) org.apache.hadoop.hive.ql.exec.spark.TestSparkInvalidFileFormat.readTextFileAsParquet (batchId=320) org.apache.hadoop.hive.ql.exec.spark.TestSparkSessionTimeout.testMultiSessionSparkSessionTimeout (batchId=254) Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/16213/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/16213/console Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-16213/ Messages: Executing org.apache.hive.ptest.execution.TestCheckPhase Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.YetusPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 6 tests failed This message is automatically generated. ATTACHMENT ID: 12949763 - PreCommit-HIVE-Build
          luguangming GuangMing Lu added a comment -

          Hi stakiar, How is the hive on spark evolving?

          luguangming GuangMing Lu added a comment - Hi stakiar , How is the hive on spark evolving?

          People

            Unassigned Unassigned
            stakiar Sahil Takiar
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: