Hive
  1. Hive
  2. HIVE-6093

table creation should fail when user does not have permissions on db

    Details

    • Release Note:
      One cannot create table (whether or not they provide a LOCATION) if they do not have WRITE permission on the database directory.

      Description

      Its possible to create a table under a database where the user does not have write permission. It can be done by specifying a LOCATION where the user has write access (say /tmp/foo). This should be restricted.

      HdfsAuthorizationProvider (which typically runs on client) checks the database directory during table creation. But StorageBasedAuthorizationProvider does not.

      1. HIVE-6093.1.patch
        4 kB
        Thejas M Nair
      2. HIVE-6093.1.patch
        4 kB
        Thejas M Nair
      3. HIVE-6093-1.patch
        4 kB
        Thiruvel Thirumoolan
      4. HIVE-6093.patch
        2 kB
        Thiruvel Thirumoolan

        Activity

        Hide
        Thejas M Nair added a comment -

        This has been fixed in 0.14 release. Please open new jira if you see any issues.

        Show
        Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.
        Hide
        Thiruvel Thirumoolan added a comment -
        Show
        Thiruvel Thirumoolan added a comment - Thanks Thejas M Nair
        Hide
        Thejas M Nair added a comment -

        This is considered a bug fix. I don't think we need additional documentation for it.

        Show
        Thejas M Nair added a comment - This is considered a bug fix. I don't think we need additional documentation for it.
        Hide
        Lefty Leverenz added a comment -

        Does this need user documentation, or is it just considered a bug fix? (In other words, would documentation bring unwanted attention to the previous behavior?)

        Show
        Lefty Leverenz added a comment - Does this need user documentation, or is it just considered a bug fix? (In other words, would documentation bring unwanted attention to the previous behavior?)
        Hide
        Thejas M Nair added a comment -

        Patch committed to trunk. Thanks for the contribution Thiruvel!

        Show
        Thejas M Nair added a comment - Patch committed to trunk. Thanks for the contribution Thiruvel!
        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12662185/HIVE-6093.1.patch

        ERROR: -1 due to 2 failed/errored test(s), 5815 tests executed
        Failed tests:

        org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataPrimitiveTypes
        org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection
        

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/352/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/352/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-352/

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 2 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12662185

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12662185/HIVE-6093.1.patch ERROR: -1 due to 2 failed/errored test(s), 5815 tests executed Failed tests: org.apache.hive.hcatalog.pig.TestOrcHCatLoader.testReadDataPrimitiveTypes org.apache.hive.jdbc.miniHS2.TestHiveServer2.testConnection Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/352/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/352/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-352/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 2 tests failed This message is automatically generated. ATTACHMENT ID: 12662185
        Hide
        Hive QA added a comment -

        Overall: -1 no tests executed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12662171/HIVE-6093.1.patch

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/349/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/349/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-349/

        Messages:

        **** This message was trimmed, see log for full details ****
        warning(200): IdentifiersParser.g:179:5: 
        Decision can match input such as "KW_STRUCT" using multiple alternatives: 4, 6
        
        As a result, alternative(s) 6 were disabled for that input
        warning(200): IdentifiersParser.g:179:5: 
        Decision can match input such as "KW_ARRAY" using multiple alternatives: 2, 6
        
        As a result, alternative(s) 6 were disabled for that input
        warning(200): IdentifiersParser.g:179:5: 
        Decision can match input such as "KW_UNIONTYPE" using multiple alternatives: 5, 6
        
        As a result, alternative(s) 6 were disabled for that input
        warning(200): IdentifiersParser.g:261:5: 
        Decision can match input such as "KW_NULL" using multiple alternatives: 1, 8
        
        As a result, alternative(s) 8 were disabled for that input
        warning(200): IdentifiersParser.g:261:5: 
        Decision can match input such as "KW_TRUE" using multiple alternatives: 3, 8
        
        As a result, alternative(s) 8 were disabled for that input
        warning(200): IdentifiersParser.g:261:5: 
        Decision can match input such as "KW_DATE StringLiteral" using multiple alternatives: 2, 3
        
        As a result, alternative(s) 3 were disabled for that input
        warning(200): IdentifiersParser.g:261:5: 
        Decision can match input such as "KW_FALSE" using multiple alternatives: 3, 8
        
        As a result, alternative(s) 8 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_CLUSTER KW_BY" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_MAP LPAREN" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_INSERT KW_OVERWRITE" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_GROUP KW_BY" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_INSERT KW_INTO" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_LATERAL KW_VIEW" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_SORT KW_BY" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_UNION KW_ALL" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_ORDER KW_BY" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "KW_BETWEEN KW_MAP LPAREN" using multiple alternatives: 8, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:393:5: 
        Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_DISTRIBUTE KW_BY" using multiple alternatives: 2, 9
        
        As a result, alternative(s) 9 were disabled for that input
        warning(200): IdentifiersParser.g:518:5: 
        Decision can match input such as "{AMPERSAND..BITWISEXOR, DIV..DIVIDE, EQUAL..EQUAL_NS, GREATERTHAN..GREATERTHANOREQUALTO, KW_AND, KW_ARRAY, KW_BETWEEN..KW_BOOLEAN, KW_CASE, KW_DOUBLE, KW_FLOAT, KW_IF, KW_IN, KW_INT, KW_LIKE, KW_MAP, KW_NOT, KW_OR, KW_REGEXP, KW_RLIKE, KW_SMALLINT, KW_STRING..KW_STRUCT, KW_TINYINT, KW_UNIONTYPE, KW_WHEN, LESSTHAN..LESSTHANOREQUALTO, MINUS..NOTEQUAL, PLUS, STAR, TILDE}" using multiple alternatives: 1, 3
        
        As a result, alternative(s) 3 were disabled for that input
        [INFO] 
        [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-exec ---
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-exec ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] Copying 2 resources
        [INFO] Copying 3 resources
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-exec ---
        [INFO] Executing tasks
        
        main:
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-exec ---
        [INFO] Compiling 1736 source files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/classes
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java: Some input files use or override a deprecated API.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java: Recompile with -Xlint:deprecation for details.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java: Some input files use unchecked or unsafe operations.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java: Recompile with -Xlint:unchecked for details.
        [INFO] 
        [INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-sources) @ hive-exec ---
        [INFO] Test Source directory: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/generated-test-sources/java added.
        [INFO] 
        [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-exec ---
        [INFO] Using 'UTF-8' encoding to copy filtered resources.
        [INFO] Copying 4 resources
        [INFO] Copying 3 resources
        [INFO] 
        [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-exec ---
        [INFO] Executing tasks
        
        main:
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/warehouse
            [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp/conf
             [copy] Copying 7 files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp/conf
        [INFO] Executed tasks
        [INFO] 
        [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-exec ---
        [INFO] Compiling 209 source files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/test-classes
        [INFO] -------------------------------------------------------------
        [WARNING] COMPILATION WARNING : 
        [INFO] -------------------------------------------------------------
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java: Some input files use or override a deprecated API.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java: Recompile with -Xlint:deprecation for details.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java: Some input files use unchecked or unsafe operations.
        [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java: Recompile with -Xlint:unchecked for details.
        [INFO] 4 warnings 
        [INFO] -------------------------------------------------------------
        [INFO] -------------------------------------------------------------
        [ERROR] COMPILATION ERROR : 
        [INFO] -------------------------------------------------------------
        [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[47,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types;
          required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext
          found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
          reason: actual and formal argument lists differ in length
        [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[97,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types;
          required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext
          found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
          reason: actual and formal argument lists differ in length
        [INFO] 2 errors 
        [INFO] -------------------------------------------------------------
        [INFO] ------------------------------------------------------------------------
        [INFO] Reactor Summary:
        [INFO] 
        [INFO] Hive .............................................. SUCCESS [9.892s]
        [INFO] Hive Ant Utilities ................................ SUCCESS [5.733s]
        [INFO] Hive Shims Common ................................. SUCCESS [4.072s]
        [INFO] Hive Shims 0.20 ................................... SUCCESS [2.767s]
        [INFO] Hive Shims Secure Common .......................... SUCCESS [4.118s]
        [INFO] Hive Shims 0.20S .................................. SUCCESS [2.775s]
        [INFO] Hive Shims 0.23 ................................... SUCCESS [6.225s]
        [INFO] Hive Shims ........................................ SUCCESS [1.313s]
        [INFO] Hive Common ....................................... SUCCESS [8.312s]
        [INFO] Hive Serde ........................................ SUCCESS [12.435s]
        [INFO] Hive Metastore .................................... SUCCESS [30.196s]
        [INFO] Hive Query Language ............................... FAILURE [1:11.339s]
        [INFO] Hive Service ...................................... SKIPPED
        [INFO] Hive JDBC ......................................... SKIPPED
        [INFO] Hive Beeline ...................................... SKIPPED
        [INFO] Hive CLI .......................................... SKIPPED
        [INFO] Hive Contrib ...................................... SKIPPED
        [INFO] Hive HBase Handler ................................ SKIPPED
        [INFO] Hive HCatalog ..................................... SKIPPED
        [INFO] Hive HCatalog Core ................................ SKIPPED
        [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED
        [INFO] Hive HCatalog Server Extensions ................... SKIPPED
        [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED
        [INFO] Hive HCatalog Webhcat ............................. SKIPPED
        [INFO] Hive HCatalog Streaming ........................... SKIPPED
        [INFO] Hive HWI .......................................... SKIPPED
        [INFO] Hive ODBC ......................................... SKIPPED
        [INFO] Hive Shims Aggregator ............................. SKIPPED
        [INFO] Hive TestUtils .................................... SKIPPED
        [INFO] Hive Packaging .................................... SKIPPED
        [INFO] ------------------------------------------------------------------------
        [INFO] BUILD FAILURE
        [INFO] ------------------------------------------------------------------------
        [INFO] Total time: 2:41.945s
        [INFO] Finished at: Fri Aug 15 18:17:03 EDT 2014
        [INFO] Final Memory: 75M/464M
        [INFO] ------------------------------------------------------------------------
        [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project hive-exec: Compilation failure: Compilation failure:
        [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[47,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types;
        [ERROR] required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext
        [ERROR] found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
        [ERROR] reason: actual and formal argument lists differ in length
        [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[97,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types;
        [ERROR] required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext
        [ERROR] found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator
        [ERROR] reason: actual and formal argument lists differ in length
        [ERROR] -> [Help 1]
        [ERROR] 
        [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
        [ERROR] Re-run Maven using the -X switch to enable full debug logging.
        [ERROR] 
        [ERROR] For more information about the errors and possible solutions, please read the following articles:
        [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
        [ERROR] 
        [ERROR] After correcting the problems, you can resume the build with the command
        [ERROR]   mvn <goals> -rf :hive-exec
        + exit 1
        '
        

        This message is automatically generated.

        ATTACHMENT ID: 12662171

        Show
        Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12662171/HIVE-6093.1.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/349/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/349/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-349/ Messages: **** This message was trimmed, see log for full details **** warning(200): IdentifiersParser.g:179:5: Decision can match input such as "KW_STRUCT" using multiple alternatives: 4, 6 As a result, alternative(s) 6 were disabled for that input warning(200): IdentifiersParser.g:179:5: Decision can match input such as "KW_ARRAY" using multiple alternatives: 2, 6 As a result, alternative(s) 6 were disabled for that input warning(200): IdentifiersParser.g:179:5: Decision can match input such as "KW_UNIONTYPE" using multiple alternatives: 5, 6 As a result, alternative(s) 6 were disabled for that input warning(200): IdentifiersParser.g:261:5: Decision can match input such as "KW_NULL" using multiple alternatives: 1, 8 As a result, alternative(s) 8 were disabled for that input warning(200): IdentifiersParser.g:261:5: Decision can match input such as "KW_TRUE" using multiple alternatives: 3, 8 As a result, alternative(s) 8 were disabled for that input warning(200): IdentifiersParser.g:261:5: Decision can match input such as "KW_DATE StringLiteral" using multiple alternatives: 2, 3 As a result, alternative(s) 3 were disabled for that input warning(200): IdentifiersParser.g:261:5: Decision can match input such as "KW_FALSE" using multiple alternatives: 3, 8 As a result, alternative(s) 8 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_CLUSTER KW_BY" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_MAP LPAREN" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_INSERT KW_OVERWRITE" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_GROUP KW_BY" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_INSERT KW_INTO" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_LATERAL KW_VIEW" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_SORT KW_BY" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_UNION KW_ALL" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_ORDER KW_BY" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "KW_BETWEEN KW_MAP LPAREN" using multiple alternatives: 8, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:393:5: Decision can match input such as "{KW_LIKE, KW_REGEXP, KW_RLIKE} KW_DISTRIBUTE KW_BY" using multiple alternatives: 2, 9 As a result, alternative(s) 9 were disabled for that input warning(200): IdentifiersParser.g:518:5: Decision can match input such as "{AMPERSAND..BITWISEXOR, DIV..DIVIDE, EQUAL..EQUAL_NS, GREATERTHAN..GREATERTHANOREQUALTO, KW_AND, KW_ARRAY, KW_BETWEEN..KW_BOOLEAN, KW_CASE, KW_DOUBLE, KW_FLOAT, KW_IF, KW_IN, KW_INT, KW_LIKE, KW_MAP, KW_NOT, KW_OR, KW_REGEXP, KW_RLIKE, KW_SMALLINT, KW_STRING..KW_STRUCT, KW_TINYINT, KW_UNIONTYPE, KW_WHEN, LESSTHAN..LESSTHANOREQUALTO, MINUS..NOTEQUAL, PLUS, STAR, TILDE}" using multiple alternatives: 1, 3 As a result, alternative(s) 3 were disabled for that input [INFO] [INFO] --- maven-remote-resources-plugin:1.5:process (default) @ hive-exec --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ hive-exec --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (define-classpath) @ hive-exec --- [INFO] Executing tasks main: [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ hive-exec --- [INFO] Compiling 1736 source files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/classes [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java: Some input files use or override a deprecated API. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/java/org/apache/hadoop/hive/ql/exec/persistence/MapJoinBytesTableContainer.java: Recompile with -Xlint:deprecation for details. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java: Some input files use unchecked or unsafe operations. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/Query.java: Recompile with -Xlint:unchecked for details. [INFO] [INFO] --- build-helper-maven-plugin:1.8:add-test-source (add-test-sources) @ hive-exec --- [INFO] Test Source directory: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/generated-test-sources/java added. [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ hive-exec --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 4 resources [INFO] Copying 3 resources [INFO] [INFO] --- maven-antrun-plugin:1.7:run (setup-test-dirs) @ hive-exec --- [INFO] Executing tasks main: [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/warehouse [mkdir] Created dir: /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp/conf [copy] Copying 7 files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/tmp/conf [INFO] Executed tasks [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ hive-exec --- [INFO] Compiling 209 source files to /data/hive-ptest/working/apache-svn-trunk-source/ql/target/test-classes [INFO] ------------------------------------------------------------- [WARNING] COMPILATION WARNING : [INFO] ------------------------------------------------------------- [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java: Some input files use or override a deprecated API. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/io/orc/TestInputOutputFormat.java: Recompile with -Xlint:deprecation for details. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java: Some input files use unchecked or unsafe operations. [WARNING] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/exec/tez/TestTezTask.java: Recompile with -Xlint:unchecked for details. [INFO] 4 warnings [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------- [ERROR] COMPILATION ERROR : [INFO] ------------------------------------------------------------- [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[47,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types; required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator reason: actual and formal argument lists differ in length [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[97,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types; required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator reason: actual and formal argument lists differ in length [INFO] 2 errors [INFO] ------------------------------------------------------------- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Hive .............................................. SUCCESS [9.892s] [INFO] Hive Ant Utilities ................................ SUCCESS [5.733s] [INFO] Hive Shims Common ................................. SUCCESS [4.072s] [INFO] Hive Shims 0.20 ................................... SUCCESS [2.767s] [INFO] Hive Shims Secure Common .......................... SUCCESS [4.118s] [INFO] Hive Shims 0.20S .................................. SUCCESS [2.775s] [INFO] Hive Shims 0.23 ................................... SUCCESS [6.225s] [INFO] Hive Shims ........................................ SUCCESS [1.313s] [INFO] Hive Common ....................................... SUCCESS [8.312s] [INFO] Hive Serde ........................................ SUCCESS [12.435s] [INFO] Hive Metastore .................................... SUCCESS [30.196s] [INFO] Hive Query Language ............................... FAILURE [1:11.339s] [INFO] Hive Service ...................................... SKIPPED [INFO] Hive JDBC ......................................... SKIPPED [INFO] Hive Beeline ...................................... SKIPPED [INFO] Hive CLI .......................................... SKIPPED [INFO] Hive Contrib ...................................... SKIPPED [INFO] Hive HBase Handler ................................ SKIPPED [INFO] Hive HCatalog ..................................... SKIPPED [INFO] Hive HCatalog Core ................................ SKIPPED [INFO] Hive HCatalog Pig Adapter ......................... SKIPPED [INFO] Hive HCatalog Server Extensions ................... SKIPPED [INFO] Hive HCatalog Webhcat Java Client ................. SKIPPED [INFO] Hive HCatalog Webhcat ............................. SKIPPED [INFO] Hive HCatalog Streaming ........................... SKIPPED [INFO] Hive HWI .......................................... SKIPPED [INFO] Hive ODBC ......................................... SKIPPED [INFO] Hive Shims Aggregator ............................. SKIPPED [INFO] Hive TestUtils .................................... SKIPPED [INFO] Hive Packaging .................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 2:41.945s [INFO] Finished at: Fri Aug 15 18:17:03 EDT 2014 [INFO] Final Memory: 75M/464M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project hive-exec: Compilation failure: Compilation failure: [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[47,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types; [ERROR] required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext [ERROR] found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator [ERROR] reason: actual and formal argument lists differ in length [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/ql/src/test/org/apache/hadoop/hive/ql/security/authorization/plugin/sqlstd/TestSQLStdHiveAccessController.java:[97,51] constructor SQLStdHiveAccessController in class org.apache.hadoop.hive.ql.security.authorization.plugin.sqlstd.SQLStdHiveAccessController cannot be applied to given types; [ERROR] required: org.apache.hadoop.hive.ql.security.authorization.plugin.HiveMetastoreClientFactory,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HiveAuthenticationProvider,org.apache.hadoop.hive.ql.security.authorization.plugin.HiveAuthzSessionContext [ERROR] found: <nulltype>,org.apache.hadoop.hive.conf.HiveConf,org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator [ERROR] reason: actual and formal argument lists differ in length [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hive-exec + exit 1 ' This message is automatically generated. ATTACHMENT ID: 12662171
        Hide
        Hive QA added a comment -

        Overall: -1 no tests executed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12661968/HIVE-6093.1.patch

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/325/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/325/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-325/

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Tests exited with: IllegalArgumentException: No propertifies found in file: mainProperties for property: spark.query.files
        

        This message is automatically generated.

        ATTACHMENT ID: 12661968

        Show
        Hive QA added a comment - Overall : -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12661968/HIVE-6093.1.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/325/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/325/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-325/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Tests exited with: IllegalArgumentException: No propertifies found in file: mainProperties for property: spark.query.files This message is automatically generated. ATTACHMENT ID: 12661968
        Hide
        Thejas M Nair added a comment -

        Attaching file in a format compatible with pre-commit test . (https://cwiki.apache.org/confluence/display/Hive/Hive+PreCommit+Patch+Testing)

        Show
        Thejas M Nair added a comment - Attaching file in a format compatible with pre-commit test . ( https://cwiki.apache.org/confluence/display/Hive/Hive+PreCommit+Patch+Testing )
        Hide
        Thejas M Nair added a comment -

        +1

        Show
        Thejas M Nair added a comment - +1
        Hide
        Thiruvel Thirumoolan added a comment -
        Show
        Thiruvel Thirumoolan added a comment - Review request @ https://reviews.apache.org/r/24705/
        Hide
        Thiruvel Thirumoolan added a comment -

        Updated patch for trunk and also added unit tests. Unit tests TestMetastoreAuthorizationProvider and TestStorageBasedMetastoreAuthorizationProvider passed. Running complete suite.

        Show
        Thiruvel Thirumoolan added a comment - Updated patch for trunk and also added unit tests. Unit tests TestMetastoreAuthorizationProvider and TestStorageBasedMetastoreAuthorizationProvider passed. Running complete suite.
        Hide
        Thiruvel Thirumoolan added a comment -

        Attaching a first approach patch. This checks the permission of database directory even if a location was specified during table creation.

        Show
        Thiruvel Thirumoolan added a comment - Attaching a first approach patch. This checks the permission of database directory even if a location was specified during table creation.

          People

          • Assignee:
            Thiruvel Thirumoolan
            Reporter:
            Thiruvel Thirumoolan
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development