Hive
  1. Hive
  2. HIVE-7025

Support retention on hive tables

    Details

    • Type: Improvement Improvement
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Query Processor
    • Labels:
      None

      Description

      Add self destruction properties for temporary tables.

      1. HIVE-7025.1.patch.txt
        5 kB
        Navis
      2. HIVE-7025.2.patch.txt
        22 kB
        Navis
      3. HIVE-7025.3.patch.txt
        31 kB
        Navis
      4. HIVE-7025.4.patch.txt
        78 kB
        Navis

        Issue Links

          Activity

          Navis created issue -
          Navis made changes -
          Field Original Value New Value
          Assignee Navis [ navis ]
          Navis made changes -
          Attachment HIVE-7025.1.patch.txt [ 12643700 ]
          Navis made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12643700/HIVE-7025.1.patch.txt

          ERROR: -1 due to 11 failed/errored test(s), 5428 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
          org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testTableFilter
          org.apache.hadoop.hive.ql.metadata.TestHive.testTable
          org.apache.hadoop.hive.ql.metadata.TestHive.testThriftTable
          org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testTable
          org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testThriftTable
          org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTablesClassic
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/141/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/141/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 11 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12643700

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12643700/HIVE-7025.1.patch.txt ERROR: -1 due to 11 failed/errored test(s), 5428 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_stats_partscan_1_23 org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testTableFilter org.apache.hadoop.hive.ql.metadata.TestHive.testTable org.apache.hadoop.hive.ql.metadata.TestHive.testThriftTable org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testTable org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testThriftTable org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTablesClassic Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/141/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/141/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 11 tests failed This message is automatically generated. ATTACHMENT ID: 12643700
          Hide
          Edward Capriolo added a comment -

          We do something similar however we also have the ability to delete partitions over a certain age. Hive already has a property inside every table called "retention" that we could consider using.

          This code is a good first step but I have one question. Isn't this code rather racey? If we have multiple CLIs running threads they could all be simultaneously deleting tables, and a CLI with a system with a misconfiguration clock could potentially delete all the tables. I think if we do this it should be a stand alone piece.

          Show
          Edward Capriolo added a comment - We do something similar however we also have the ability to delete partitions over a certain age. Hive already has a property inside every table called "retention" that we could consider using. This code is a good first step but I have one question. Isn't this code rather racey? If we have multiple CLIs running threads they could all be simultaneously deleting tables, and a CLI with a system with a misconfiguration clock could potentially delete all the tables. I think if we do this it should be a stand alone piece.
          Hide
          Navis added a comment -

          Edward Capriolo Yes, dangerous. I think "METASTORE_TABLES_TTL_DATABASE" also should be a required property to apply this policy. All temporary tables could be created only on that. Regard this conceptual draft.

          Show
          Navis added a comment - Edward Capriolo Yes, dangerous. I think "METASTORE_TABLES_TTL_DATABASE" also should be a required property to apply this policy. All temporary tables could be created only on that. Regard this conceptual draft.
          Navis made changes -
          Summary TTL on hive tables Support retention on hive tables
          Navis made changes -
          Attachment HIVE-7025.2.patch.txt [ 12645951 ]
          Hide
          Navis added a comment -

          Edward Capriolo Re-implemented to use the retention property in table object and now it supports partitioned tables also (drops old partitions instead of the table). Might be better then previous version, but I cannot make RB entry for this (RB throws "The file 'common/src/java/org/apache/hadoop/hive/conf/HiveConf.java' (r0c7c0d7) could not be found in the repository").

          Show
          Navis added a comment - Edward Capriolo Re-implemented to use the retention property in table object and now it supports partitioned tables also (drops old partitions instead of the table). Might be better then previous version, but I cannot make RB entry for this (RB throws "The file 'common/src/java/org/apache/hadoop/hive/conf/HiveConf.java' (r0c7c0d7) could not be found in the repository").
          Hide
          Hive QA added a comment -

          Overall: -1 no tests executed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12645951/HIVE-7025.2.patch.txt

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/257/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/257/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-257/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Tests exited with: NonZeroExitCodeException
          Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]]
          + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
          + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera
          + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
          + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin
          + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
          + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
          + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
          + cd /data/hive-ptest/working/
          + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-257/source-prep.txt
          + [[ false == \t\r\u\e ]]
          + mkdir -p maven ivy
          + [[ svn = \s\v\n ]]
          + [[ -n '' ]]
          + [[ -d apache-svn-trunk-source ]]
          + [[ ! -d apache-svn-trunk-source/.svn ]]
          + [[ ! -d apache-svn-trunk-source ]]
          + cd apache-svn-trunk-source
          + svn revert -R .
          Reverted 'itests/util/src/main/java/org/apache/hadoop/hive/ql/hooks/VerifyNumReducersHook.java'
          Reverted 'itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/show_create_table_alter.q.out'
          Reverted 'ql/src/test/results/clientpositive/bucketizedhiveinputformat.q.out'
          Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out'
          Reverted 'ql/src/test/results/clientpositive/nullformatCTAS.q.out'
          Reverted 'ql/src/test/queries/clientpositive/groupby_sort_1.q'
          Reverted 'ql/src/test/queries/clientpositive/bucketizedhiveinputformat.q'
          Reverted 'ql/src/test/queries/clientpositive/groupby_sort_skew_1.q'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java'
          Reverted 'ql/src/java/org/apache/hadoop/hive/ql/Driver.java'
          ++ egrep -v '^X|^Performing status on external'
          ++ awk '{print $2}'
          ++ svn status --no-ignore
          + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/util/src/main/java/org/apache/hadoop/hive/ql/hooks/ShowMapredStatsHook.java hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientpositive/groupby_sort_skew_1_23.q.out ql/src/test/results/clientpositive/groupby_sort_1_23.q.out ql/src/test/queries/clientpositive/groupby_sort_skew_1_23.q ql/src/test/queries/clientpositive/groupby_sort_1_23.q
          + svn update
          
          Fetching external item into 'hcatalog/src/test/e2e/harness'
          External at revision 1596672.
          
          At revision 1596672.
          + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
          + patchFilePath=/data/hive-ptest/working/scratch/build.patch
          + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
          + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
          + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
          The patch does not appear to apply with p0, p1, or p2
          + exit 1
          '
          

          This message is automatically generated.

          ATTACHMENT ID: 12645951

          Show
          Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12645951/HIVE-7025.2.patch.txt Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/257/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/257/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-257/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n /usr/java/jdk1.7.0_45-cloudera ]] + export JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + JAVA_HOME=/usr/java/jdk1.7.0_45-cloudera + export PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + PATH=/usr/java/jdk1.7.0_45-cloudera/bin/:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-maven-3.0.5/bin:/usr/local/apache-maven-3.0.5/bin:/usr/java/jdk1.6.0_34/bin:/usr/local/apache-ant-1.9.1/bin:/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/hiveptest/bin + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-257/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . Reverted 'itests/util/src/main/java/org/apache/hadoop/hive/ql/hooks/VerifyNumReducersHook.java' Reverted 'itests/util/src/main/java/org/apache/hadoop/hive/ql/QTestUtil.java' Reverted 'ql/src/test/results/clientpositive/groupby_sort_1.q.out' Reverted 'ql/src/test/results/clientpositive/show_create_table_alter.q.out' Reverted 'ql/src/test/results/clientpositive/bucketizedhiveinputformat.q.out' Reverted 'ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out' Reverted 'ql/src/test/results/clientpositive/nullformatCTAS.q.out' Reverted 'ql/src/test/queries/clientpositive/groupby_sort_1.q' Reverted 'ql/src/test/queries/clientpositive/bucketizedhiveinputformat.q' Reverted 'ql/src/test/queries/clientpositive/groupby_sort_skew_1.q' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/mr/HadoopJobExecHelper.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/Driver.java' ++ egrep -v '^X|^Performing status on external' ++ awk '{print $2}' ++ svn status --no-ignore + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-minikdc/target itests/hive-unit/target itests/custom-serde/target itests/util/target itests/util/src/main/java/org/apache/hadoop/hive/ql/hooks/ShowMapredStatsHook.java hcatalog/target hcatalog/core/target hcatalog/streaming/target hcatalog/server-extensions/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target ql/src/test/results/clientpositive/groupby_sort_skew_1_23.q.out ql/src/test/results/clientpositive/groupby_sort_1_23.q.out ql/src/test/queries/clientpositive/groupby_sort_skew_1_23.q ql/src/test/queries/clientpositive/groupby_sort_1_23.q + svn update Fetching external item into 'hcatalog/src/test/e2e/harness' External at revision 1596672. At revision 1596672. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12645951
          Navis made changes -
          Attachment HIVE-7025.3.patch.txt [ 12654483 ]
          Hide
          Edward Capriolo added a comment -

          I like this. I coded something like this by hand at my last job. I did run into issue where tables with huge number of partitions caused memory issues and had to page / limit the number of objects I would access in one go.

          Anyway your test case does not include a partitioned table. I am assuming the reinvention is set on the table but you are using the create time of the partition? It might be good to include that in your unit test.

          Show
          Edward Capriolo added a comment - I like this. I coded something like this by hand at my last job. I did run into issue where tables with huge number of partitions caused memory issues and had to page / limit the number of objects I would access in one go. Anyway your test case does not include a partitioned table. I am assuming the reinvention is set on the table but you are using the create time of the partition? It might be good to include that in your unit test.
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12654483/HIVE-7025.3.patch.txt

          ERROR: -1 due to 20 failed/errored test(s), 5702 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2
          org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testPartition
          org.apache.hadoop.hive.metastore.TestMetaStoreEventListener.testListener
          org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartition
          org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartition
          org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testPartition
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testTableFilter
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testPartition
          org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testTableFilter
          org.apache.hadoop.hive.ql.metadata.TestHive.testTable
          org.apache.hadoop.hive.ql.metadata.TestHive.testThriftTable
          org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testTable
          org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testThriftTable
          org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTables
          org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTablesHive
          org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/717/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/717/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-717/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 20 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12654483

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12654483/HIVE-7025.3.patch.txt ERROR: -1 due to 20 failed/errored test(s), 5702 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_schemeAuthority2 org.apache.hadoop.hive.metastore.TestEmbeddedHiveMetaStore.testPartition org.apache.hadoop.hive.metastore.TestMetaStoreEventListener.testListener org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testPartition org.apache.hadoop.hive.metastore.TestRemoteHiveMetaStore.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnBothClientServer.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyClient.testTableFilter org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testPartition org.apache.hadoop.hive.metastore.TestSetUGIOnOnlyServer.testTableFilter org.apache.hadoop.hive.ql.metadata.TestHive.testTable org.apache.hadoop.hive.ql.metadata.TestHive.testThriftTable org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testTable org.apache.hadoop.hive.ql.metadata.TestHiveRemote.testThriftTable org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTables org.apache.hive.jdbc.TestJdbcDriver2.testMetaDataGetTablesHive org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/717/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/717/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-717/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 20 tests failed This message is automatically generated. ATTACHMENT ID: 12654483
          Navis made changes -
          Attachment HIVE-7025.4.patch.txt [ 12654758 ]
          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12654758/HIVE-7025.4.patch.txt

          ERROR: -1 due to 2 failed/errored test(s), 5704 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization
          org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table
          

          Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/719/testReport
          Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/719/console
          Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-719/

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 2 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12654758

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12654758/HIVE-7025.4.patch.txt ERROR: -1 due to 2 failed/errored test(s), 5704 tests executed Failed tests: org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_dynpart_sort_optimization org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_root_dir_external_table Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/719/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-Build/719/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-Build-719/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12654758
          Navis made changes -
          Remote Link This issue links to "review board (Web Link)" [ 15818 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          46s 1 Navis 07/May/14 07:09

            People

            • Assignee:
              Navis
              Reporter:
              Navis
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:

                Development