Hive
  1. Hive
  2. HIVE-6643

Add a check for cross products in plans and output a warning

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Added new config parameter 'hive.exec.check.crossproducts' to warn about Cross Products. By default this check is on.

      Description

      Now that we support old style join syntax, it is easy to write queries that generate a plan with a cross product.
      For e.g. say you have A join B join C join D on A.x = B.x and A.y = D.y and C.z = D.z
      So the JoinTree is:

      A — B

      __ D — C

      Since we don't reorder join graphs, we will end up with a cross product between (A join B) and C

      1. HIVE-6643.1.patch
        124 kB
        Harish Butani
      2. HIVE-6643.2.patch
        125 kB
        Harish Butani
      3. HIVE-6643.3.patch
        125 kB
        Harish Butani
      4. HIVE-6643.4.patch
        135 kB
        Harish Butani
      5. HIVE-6643.5.patch
        161 kB
        Harish Butani
      6. HIVE-6643.6.patch
        167 kB
        Harish Butani
      7. HIVE-6643.7.patch
        167 kB
        Harish Butani

        Activity

        Harish Butani created issue -
        Harish Butani made changes -
        Field Original Value New Value
        Attachment HIVE-6643.1.patch [ 12634302 ]
        Hide
        Harish Butani added a comment -

        preliminary patch attached. There are some issues with this:

        • for MapJoins: the warning only shows the bigTable (even this is not available). Hopefully the Vertex/Stage and Operator information is enough for the user to see where the cross product is happening.
        • for Shuffle Joins: we need the HIVE-4293 changes to show the tables in a Reducer that has more than 1 input.
        • the .q.out files have the warnings, but these are appearing before the preehooks for the queries. Is this ok?
        Show
        Harish Butani added a comment - preliminary patch attached. There are some issues with this: for MapJoins: the warning only shows the bigTable (even this is not available). Hopefully the Vertex/Stage and Operator information is enough for the user to see where the cross product is happening. for Shuffle Joins: we need the HIVE-4293 changes to show the tables in a Reducer that has more than 1 input. the .q.out files have the warnings, but these are appearing before the preehooks for the queries. Is this ok?
        Hide
        Harish Butani added a comment -
        Show
        Harish Butani added a comment - review at: https://reviews.apache.org/r/19165/
        Hide
        Gunther Hagleitner added a comment -

        Minor comments on rb. This is neat: +1

        Show
        Gunther Hagleitner added a comment - Minor comments on rb. This is neat: +1
        Hide
        Harish Butani added a comment -

        thanks gunther for the review.
        Will make the changes you have suggested.
        Submitting patch to check if any existing tests are affected by this check.

        Show
        Harish Butani added a comment - thanks gunther for the review. Will make the changes you have suggested. Submitting patch to check if any existing tests are affected by this check.
        Harish Butani made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Hive QA added a comment -

        Overall: -1 no tests executed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12634302/HIVE-6643.1.patch

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1800/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1800/console

        Messages:

        **** This message was trimmed, see log for full details ****
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hwi/src/test/resources
        [INFO] Copying 3 resources
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-hwi ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/warehouse
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf
             [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-hwi ---
        [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/test-classes
        [INFO] 
        [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hwi ---
        [INFO] Tests are skipped.
        [INFO] 
        [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hwi ---
        [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar
        [INFO] 
        [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-hwi ---
        [INFO] 
        [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hwi ---
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.jar
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.pom
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Hive ODBC 0.14.0-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        [INFO] 
        [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-odbc ---
        [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/odbc (includes = [datanucleus.log, derby.log], excludes = [])
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-odbc ---
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-odbc ---
        [INFO] Executing tasks
        
        main:
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/warehouse
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf
             [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-odbc ---
        [INFO] 
        [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc ---
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/odbc/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-odbc/0.14.0-SNAPSHOT/hive-odbc-0.14.0-SNAPSHOT.pom
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Hive Shims Aggregator 0.14.0-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        [INFO] 
        [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator ---
        [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/shims (includes = [datanucleus.log, derby.log], excludes = [])
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-shims-aggregator ---
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-aggregator ---
        [INFO] Executing tasks
        
        main:
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-shims-aggregator ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/warehouse
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf
             [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-shims-aggregator ---
        [INFO] 
        [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-shims-aggregator ---
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/shims/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-shims-aggregator/0.14.0-SNAPSHOT/hive-shims-aggregator-0.14.0-SNAPSHOT.pom
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Hive TestUtils 0.14.0-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        [INFO] 
        [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils ---
        [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/testutils (includes = [datanucleus.log, derby.log], excludes = [])
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-testutils ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/main/resources
        [INFO] Copying 3 resources
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils ---
        [INFO] Executing tasks
        
        main:
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-testutils ---
        [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/classes
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-testutils ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/test/resources
        [INFO] Copying 3 resources
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-testutils ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/warehouse
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf
             [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-testutils ---
        [INFO] No sources to compile
        [INFO] 
        [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-testutils ---
        [INFO] Tests are skipped.
        [INFO] 
        [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-testutils ---
        [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar
        [INFO] 
        [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-testutils ---
        [INFO] 
        [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-testutils ---
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.jar
        [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.pom
        [INFO]                                                                         
        [INFO] ------------------------------------------------------------------------
        [INFO] Building Hive Packaging 0.14.0-SNAPSHOT
        [INFO] ------------------------------------------------------------------------
        Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/maven-metadata.xml
        Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.pom
        [WARNING] The POM for org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT is missing, no dependency information available
        Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.jar
        [INFO] ------------------------------------------------------------------------
        [INFO] Reactor Summary:
        [INFO] 
        [INFO] Hive .............................................. SUCCESS [8.918s]
        [INFO] Hive Ant Utilities ................................ SUCCESS [5.815s]
        [INFO] Hive Shims Common ................................. SUCCESS [3.693s]
        [INFO] Hive Shims 0.20 ................................... SUCCESS [2.572s]
        [INFO] Hive Shims Secure Common .......................... SUCCESS [4.309s]
        [INFO] Hive Shims 0.20S .................................. SUCCESS [2.582s]
        [INFO] Hive Shims 0.23 ................................... SUCCESS [7.943s]
        [INFO] Hive Shims ........................................ SUCCESS [1.239s]
        [INFO] Hive Common ....................................... SUCCESS [6.691s]
        [INFO] Hive Serde ........................................ SUCCESS [9.978s]
        [INFO] Hive Metastore .................................... SUCCESS [33.677s]
        [INFO] Hive Query Language ............................... SUCCESS [1:16.466s]
        [INFO] Hive Service ...................................... SUCCESS [7.008s]
        [INFO] Hive JDBC ......................................... SUCCESS [3.162s]
        [INFO] Hive Beeline ...................................... SUCCESS [2.818s]
        [INFO] Hive CLI .......................................... SUCCESS [1.826s]
        [INFO] Hive Contrib ...................................... SUCCESS [1.822s]
        [INFO] Hive HBase Handler ................................ SUCCESS [3.739s]
        [INFO] Hive HCatalog ..................................... SUCCESS [0.514s]
        [INFO] Hive HCatalog Core ................................ SUCCESS [2.778s]
        [INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [1.586s]
        [INFO] Hive HCatalog Server Extensions ................... SUCCESS [2.044s]
        [INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [1.540s]
        [INFO] Hive HCatalog Webhcat ............................. SUCCESS [10.170s]
        [INFO] Hive HWI .......................................... SUCCESS [1.263s]
        [INFO] Hive ODBC ......................................... SUCCESS [0.759s]
        [INFO] Hive Shims Aggregator ............................. SUCCESS [0.299s]
        [INFO] Hive TestUtils .................................... SUCCESS [0.639s]
        [INFO] Hive Packaging .................................... FAILURE [1.617s]
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD FAILURE
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 3:32.251s
        [INFO] Finished at: Sat Mar 15 03:43:26 EDT 2014
        [INFO] Final Memory: 74M/553M
        [INFO] ------------------------------------------------------------------------
        [ERROR] Failed to execute goal on project hive-packaging: Could not resolve dependencies for project org.apache.hive:hive-packaging:pom:0.14.0-SNAPSHOT: Could not find artifact org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1]
        [ERROR] 
        [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
        [ERROR] Re-run Maven using the -X switch to enable full debug logging.
        [ERROR] 
        [ERROR] For more information about the errors and possible solutions, please read the following articles:
        [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
        [ERROR] 
        [ERROR] After correcting the problems, you can resume the build with the command
        [ERROR]   mvn <goals> -rf :hive-packaging
        + exit 1
        '
        

        This message is automatically generated.

        ATTACHMENT ID: 12634302

        Show
        Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12634302/HIVE-6643.1.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1800/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1800/console Messages: **** This message was trimmed, see log for full details **** [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/hwi/src/test/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-hwi --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-hwi --- [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/test-classes [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-hwi --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-hwi --- [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-hwi --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-hwi --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/target/hive-hwi-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.jar [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/hwi/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-hwi/0.14.0-SNAPSHOT/hive-hwi-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive ODBC 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-odbc --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/odbc (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-odbc --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-odbc --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-odbc --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/odbc/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-odbc --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-odbc --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/odbc/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-odbc/0.14.0-SNAPSHOT/hive-odbc-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive Shims Aggregator 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-shims-aggregator --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/shims (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-shims-aggregator --- [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-shims-aggregator --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-shims-aggregator --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/shims/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-shims-aggregator --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-shims-aggregator --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/shims/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-shims-aggregator/0.14.0-SNAPSHOT/hive-shims-aggregator-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive TestUtils 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hive-testutils --- [INFO] Deleting /data/hive-ptest/working/apache-svn-trunk-source/testutils (includes = [datanucleus.log, derby.log], excludes = []) [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-testutils --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-testutils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/main/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-testutils --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-testutils --- [INFO] Compiling 2 source files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/classes [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-testutils --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory /data/hive-ptest/working/apache-svn-trunk-source/testutils/src/test/resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-testutils --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf [copy] Copying 5 files to /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-testutils --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.16:test (default-test) @ hive-testutils --- [INFO] Tests are skipped. [INFO] [INFO] --- maven-jar-plugin:2.2:jar (default-jar) @ hive-testutils --- [INFO] Building jar: /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar [INFO] [INFO] --- maven-site-plugin:3.3:attach-descriptor (attach-descriptor) @ hive-testutils --- [INFO] [INFO] --- maven-install-plugin:2.4:install (default-install) @ hive-testutils --- [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/target/hive-testutils-0.14.0-SNAPSHOT.jar to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.jar [INFO] Installing /data/hive-ptest/working/apache-svn-trunk-source/testutils/pom.xml to /data/hive-ptest/working/maven/org/apache/hive/hive-testutils/0.14.0-SNAPSHOT/hive-testutils-0.14.0-SNAPSHOT.pom [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Hive Packaging 0.14.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/maven-metadata.xml Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.pom [WARNING] The POM for org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT is missing, no dependency information available Downloading: http://repository.apache.org/snapshots/org/apache/hive/hcatalog/hive-hcatalog-hbase-storage-handler/0.14.0-SNAPSHOT/hive-hcatalog-hbase-storage-handler-0.14.0-SNAPSHOT.jar [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Hive .............................................. SUCCESS [8.918s] [INFO] Hive Ant Utilities ................................ SUCCESS [5.815s] [INFO] Hive Shims Common ................................. SUCCESS [3.693s] [INFO] Hive Shims 0.20 ................................... SUCCESS [2.572s] [INFO] Hive Shims Secure Common .......................... SUCCESS [4.309s] [INFO] Hive Shims 0.20S .................................. SUCCESS [2.582s] [INFO] Hive Shims 0.23 ................................... SUCCESS [7.943s] [INFO] Hive Shims ........................................ SUCCESS [1.239s] [INFO] Hive Common ....................................... SUCCESS [6.691s] [INFO] Hive Serde ........................................ SUCCESS [9.978s] [INFO] Hive Metastore .................................... SUCCESS [33.677s] [INFO] Hive Query Language ............................... SUCCESS [1:16.466s] [INFO] Hive Service ...................................... SUCCESS [7.008s] [INFO] Hive JDBC ......................................... SUCCESS [3.162s] [INFO] Hive Beeline ...................................... SUCCESS [2.818s] [INFO] Hive CLI .......................................... SUCCESS [1.826s] [INFO] Hive Contrib ...................................... SUCCESS [1.822s] [INFO] Hive HBase Handler ................................ SUCCESS [3.739s] [INFO] Hive HCatalog ..................................... SUCCESS [0.514s] [INFO] Hive HCatalog Core ................................ SUCCESS [2.778s] [INFO] Hive HCatalog Pig Adapter ......................... SUCCESS [1.586s] [INFO] Hive HCatalog Server Extensions ................... SUCCESS [2.044s] [INFO] Hive HCatalog Webhcat Java Client ................. SUCCESS [1.540s] [INFO] Hive HCatalog Webhcat ............................. SUCCESS [10.170s] [INFO] Hive HWI .......................................... SUCCESS [1.263s] [INFO] Hive ODBC ......................................... SUCCESS [0.759s] [INFO] Hive Shims Aggregator ............................. SUCCESS [0.299s] [INFO] Hive TestUtils .................................... SUCCESS [0.639s] [INFO] Hive Packaging .................................... FAILURE [1.617s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 3:32.251s [INFO] Finished at: Sat Mar 15 03:43:26 EDT 2014 [INFO] Final Memory: 74M/553M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal on project hive-packaging: Could not resolve dependencies for project org.apache.hive:hive-packaging:pom:0.14.0-SNAPSHOT: Could not find artifact org.apache.hive.hcatalog:hive-hcatalog-hbase-storage-handler:jar:0.14.0-SNAPSHOT in apache.snapshots (http://repository.apache.org/snapshots) -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hive-packaging + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12634302
        Harish Butani made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Harish Butani made changes -
        Attachment HIVE-6643.2.patch [ 12635022 ]
        Harish Butani made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Hive QA added a comment -

        Overall: -1 no tests executed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12635022/HIVE-6643.2.patch

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1864/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1864/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Tests exited with: NonZeroExitCodeException
        Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]]
        + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
        + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
        + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
        + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128'
        + cd /data/hive-ptest/working/
        + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1864/source-prep.txt
        + [[ false == \t\r\u\e ]]
        + mkdir -p maven ivy
        + [[ svn = \s\v\n ]]
        + [[ -n '' ]]
        + [[ -d apache-svn-trunk-source ]]
        + [[ ! -d apache-svn-trunk-source/.svn ]]
        + [[ ! -d apache-svn-trunk-source ]]
        + cd apache-svn-trunk-source
        + svn revert -R .
        Reverted 'metastore/scripts/upgrade/derby/hive-schema-0.13.0.derby.sql'
        Reverted 'metastore/scripts/upgrade/derby/hive-schema-0.14.0.derby.sql'
        Reverted 'metastore/scripts/upgrade/mysql/hive-schema-0.13.0.mysql.sql'
        Reverted 'metastore/scripts/upgrade/mysql/hive-schema-0.14.0.mysql.sql'
        Reverted 'metastore/scripts/upgrade/oracle/hive-schema-0.13.0.oracle.sql'
        Reverted 'metastore/scripts/upgrade/oracle/hive-schema-0.14.0.oracle.sql'
        Reverted 'metastore/scripts/upgrade/postgres/hive-schema-0.14.0.postgres.sql'
        Reverted 'metastore/scripts/upgrade/postgres/hive-schema-0.13.0.postgres.sql'
        ++ awk '{print $2}'
        ++ egrep -v '^X|^Performing status on external'
        ++ svn status --no-ignore
        + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit/target itests/custom-serde/target itests/util/target hcatalog/target hcatalog/storage-handlers/hbase/target hcatalog/server-extensions/target hcatalog/core/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target
        + svn update
        U    itests/qtest/pom.xml
        U    common/src/test/org/apache/hadoop/hive/common/type/TestDecimal128.java
        U    common/src/java/org/apache/hadoop/hive/conf/HiveConf.java
        U    common/src/java/org/apache/hadoop/hive/common/type/Decimal128.java
        U    ql/src/test/results/clientpositive/vector_decimal_aggregate.q.out
        A    ql/src/test/results/clientpositive/tez/orc_analyze.q.out
        A    ql/src/test/results/clientpositive/orc_analyze.q.out
        A    ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFPrintf.java
        A    ql/src/test/queries/clientpositive/orc_analyze.q
        A    ql/src/java/org/apache/hadoop/hive/ql/plan/StatsNoJobWork.java
        U    ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFPrintf.java
        U    ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java
        A    ql/src/java/org/apache/hadoop/hive/ql/exec/StatsNoJobTask.java
        U    ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/MathExpr.java
        U    ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/aggregates/VectorUDAFSumDecimal.java
        U    ql/src/java/org/apache/hadoop/hive/ql/exec/TaskFactory.java
        A    ql/src/java/org/apache/hadoop/hive/ql/io/StatsProvidingRecordReader.java
        U    ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java
        U    ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java
        U    ql/src/java/org/apache/hadoop/hive/ql/parse/ProcessAnalyzeTable.java
        U    ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
        U    ql/src/gen/vectorization/UDAFTemplates/VectorUDAFVarDecimal.txt
        U    conf/hive-default.xml.template
        
        Fetching external item into 'hcatalog/src/test/e2e/harness'
        Updated external to revision 1578659.
        
        Updated to revision 1578659.
        + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh
        + patchFilePath=/data/hive-ptest/working/scratch/build.patch
        + [[ -f /data/hive-ptest/working/scratch/build.patch ]]
        + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh
        + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch
        The patch does not appear to apply with p0, p1, or p2
        + exit 1
        '
        

        This message is automatically generated.

        ATTACHMENT ID: 12635022

        Show
        Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12635022/HIVE-6643.2.patch Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1864/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1864/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Tests exited with: NonZeroExitCodeException Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]] + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m ' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m ' + export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-1864/source-prep.txt + [[ false == \t\r\u\e ]] + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . Reverted 'metastore/scripts/upgrade/derby/hive-schema-0.13.0.derby.sql' Reverted 'metastore/scripts/upgrade/derby/hive-schema-0.14.0.derby.sql' Reverted 'metastore/scripts/upgrade/mysql/hive-schema-0.13.0.mysql.sql' Reverted 'metastore/scripts/upgrade/mysql/hive-schema-0.14.0.mysql.sql' Reverted 'metastore/scripts/upgrade/oracle/hive-schema-0.13.0.oracle.sql' Reverted 'metastore/scripts/upgrade/oracle/hive-schema-0.14.0.oracle.sql' Reverted 'metastore/scripts/upgrade/postgres/hive-schema-0.14.0.postgres.sql' Reverted 'metastore/scripts/upgrade/postgres/hive-schema-0.13.0.postgres.sql' ++ awk '{print $2}' ++ egrep -v '^X|^Performing status on external' ++ svn status --no-ignore + rm -rf target datanucleus.log ant/target shims/target shims/0.20/target shims/0.20S/target shims/0.23/target shims/aggregator/target shims/common/target shims/common-secure/target packaging/target hbase-handler/target testutils/target jdbc/target metastore/target itests/target itests/hcatalog-unit/target itests/test-serde/target itests/qtest/target itests/hive-unit/target itests/custom-serde/target itests/util/target hcatalog/target hcatalog/storage-handlers/hbase/target hcatalog/server-extensions/target hcatalog/core/target hcatalog/webhcat/svr/target hcatalog/webhcat/java-client/target hcatalog/hcatalog-pig-adapter/target hwi/target common/target common/src/gen contrib/target service/target serde/target beeline/target odbc/target cli/target ql/dependency-reduced-pom.xml ql/target + svn update U itests/qtest/pom.xml U common/src/test/org/apache/hadoop/hive/common/type/TestDecimal128.java U common/src/java/org/apache/hadoop/hive/conf/HiveConf.java U common/src/java/org/apache/hadoop/hive/common/type/Decimal128.java U ql/src/test/results/clientpositive/vector_decimal_aggregate.q.out A ql/src/test/results/clientpositive/tez/orc_analyze.q.out A ql/src/test/results/clientpositive/orc_analyze.q.out A ql/src/test/org/apache/hadoop/hive/ql/udf/generic/TestGenericUDFPrintf.java A ql/src/test/queries/clientpositive/orc_analyze.q A ql/src/java/org/apache/hadoop/hive/ql/plan/StatsNoJobWork.java U ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFPrintf.java U ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMRTableScan1.java A ql/src/java/org/apache/hadoop/hive/ql/exec/StatsNoJobTask.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/MathExpr.java U ql/src/java/org/apache/hadoop/hive/ql/exec/vector/expressions/aggregates/VectorUDAFSumDecimal.java U ql/src/java/org/apache/hadoop/hive/ql/exec/TaskFactory.java A ql/src/java/org/apache/hadoop/hive/ql/io/StatsProvidingRecordReader.java U ql/src/java/org/apache/hadoop/hive/ql/io/orc/ReaderImpl.java U ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcInputFormat.java U ql/src/java/org/apache/hadoop/hive/ql/parse/ProcessAnalyzeTable.java U ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java U ql/src/gen/vectorization/UDAFTemplates/VectorUDAFVarDecimal.txt U conf/hive-default.xml.template Fetching external item into 'hcatalog/src/test/e2e/harness' Updated external to revision 1578659. Updated to revision 1578659. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0, p1, or p2 + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12635022
        Harish Butani made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Harish Butani made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Harish Butani made changes -
        Fix Version/s 0.13.0 [ 12324986 ]
        Harish Butani made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Harish Butani made changes -
        Attachment HIVE-6643.3.patch [ 12636417 ]
        Harish Butani made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Harish Butani made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Harish Butani made changes -
        Attachment HIVE-6643.4.patch [ 12636943 ]
        Hide
        Alan Gates added a comment -

        I see the following errors when I run the tests:
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join0
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join23
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_nulls
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_12
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cross_join
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input23
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_alt_syntax
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_1
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_3
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual1
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual3
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_filters
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_nulls
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_no_hooks
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonblock_op_deduplicate
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_repeated_alias
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_print_header
        2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample8

        Show
        Alan Gates added a comment - I see the following errors when I run the tests: 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join0 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join23 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_nulls 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_sortmerge_join_12 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_create_view 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cross_join 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input23 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_alt_syntax 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_1 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_3 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual1 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_cond_pushdown_unqual3 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_filters 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_nulls 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_no_hooks 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonblock_op_deduplicate 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_ppd_repeated_alias 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_print_header 2014-03-26 17:33:15 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_sample8
        Harish Butani made changes -
        Attachment HIVE-6643.5.patch [ 12637001 ]
        Hide
        Harish Butani added a comment -

        fix .q.out diffs

        Show
        Harish Butani added a comment - fix .q.out diffs
        Hide
        Alan Gates added a comment -

        I still see the following failures when running the tests on the latest patch:
        2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input23
        2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0
        2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23

        Show
        Alan Gates added a comment - I still see the following failures when running the tests on the latest patch: 2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input23 2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join0 2014-03-27 01:20:45 WARN PTest:205 - org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join23
        Harish Butani made changes -
        Attachment HIVE-6643.6.patch [ 12637315 ]
        Hide
        Harish Butani added a comment -

        fix more .q.out files

        Show
        Harish Butani added a comment - fix more .q.out files
        Hide
        Thejas M Nair added a comment -

        Ran tests locally and they passed.

        Show
        Thejas M Nair added a comment - Ran tests locally and they passed.
        Hide
        Harish Butani added a comment -

        fix merge conflicts

        Show
        Harish Butani added a comment - fix merge conflicts
        Harish Butani made changes -
        Attachment HIVE-6643.7.patch [ 12637578 ]
        Hide
        Harish Butani added a comment -

        Committed to trunk and 0.13
        Gunther thanks for the review
        Thejas thanks for running the tests.

        Show
        Harish Butani added a comment - Committed to trunk and 0.13 Gunther thanks for the review Thejas thanks for running the tests.
        Harish Butani made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Lefty Leverenz added a comment -

        This adds hive.exec.check.crossproducts to HiveConf.java and hive-default.xml.template, so I'll add it to the wiki and include it in HIVE-6586 so the description can be put in the new HiveConf.java after HIVE-6037 gets committed.

        Show
        Lefty Leverenz added a comment - This adds hive.exec.check.crossproducts to HiveConf.java and hive-default.xml.template, so I'll add it to the wiki and include it in HIVE-6586 so the description can be put in the new HiveConf.java after HIVE-6037 gets committed.
        Hide
        Lefty Leverenz added a comment -

        A release note for hive.exec.check.crossproducts would also be good.

        Show
        Lefty Leverenz added a comment - A release note for hive.exec.check.crossproducts would also be good.
        Harish Butani made changes -
        Release Note Added new config parameter 'hive.exec.check.crossproducts' to warn about Cross Products. By default this check is on.
        Hide
        Harish Butani added a comment -

        Thanks for updating the wiki.
        Added the Release Note.

        Show
        Harish Butani added a comment - Thanks for updating the wiki. Added the Release Note.
        Hide
        Lefty Leverenz added a comment -

        hive.exec.check.crossproducts is documented in the wiki here:

        I added a comment to HIVE-6586 so it won't get lost in the shuffle when HIVE-6037 changes HiveConf.java.

        Show
        Lefty Leverenz added a comment - hive.exec.check.crossproducts is documented in the wiki here: Configuration Properties – hive.exec.check.crossproducts I added a comment to HIVE-6586 so it won't get lost in the shuffle when HIVE-6037 changes HiveConf.java.

          People

          • Assignee:
            Harish Butani
            Reporter:
            Harish Butani
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development