[SENTRY-41] Enable sentry end to end tests to run on a real cluster

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0
• Assignee: Sravya Tirukkovalur
• Reporter: Sravya Tirukkovalur
• Created: 09/Oct/13 22:47
• Updated: 21/Jan/14 07:11
• Resolved: 25/Oct/13 03:42

Description

Adding a DFS implementation, ClusterDFS, which along with UnmanagedHiveServer can be used to run tests on real secure cluster.

• Adding a maven profile which sets the required classpath and runs only the tests which are supported to run on real secure cluster with an UnmanagedHiveServer.
  • Tests which will be run with "cluster-haoop" profile:
    • TestCrossDbOps
    • TestEndToEnd
    • TestMetadataObjectRetrieval
    • TestMetadataPermissions
    • TestMovingToProduction
    • TestPerDatabasePolicyFile
    • TestPrivilegeAtTransform
    • TestPrivilegesAtDatabaseScope
    • TestPrivilegesAtTableScope
    • TestSandboxOps
    • TestExportImportPrivileges
    • TestUriPermissions
    • TestRuntimeMetadataRetrieval
  • Tests which will not be run:
    • TestUserManagement (had non static user:group mapping)
    • TestServerConfiguration (uses a managed hive server)
    • TestSentryOnFailureHookLoading (uses a managed hive server)
    • TestPrivilegesAtFunctionScope (has not been added as it results in a failure due to SENTRY-23)
    • TestPerDBConfiguration (has not been added as it uses a special java property)

Running the tests:
Prerequisites:

• Need to setup a secure cluster with sentry enabled
• Need to have the static user:group mapping setup
• Need to set HIVE_CONF_DIR and HADOOP_CONF_DIR
  mvn clean package -Pcluster-hadoop -Dsentry.e2etest.policyOwnerKeytab=</path/to/keytab> -Dsentry.e2etest.policyOwnerPrincipal=<principal> -Dhive.server2.thrift.bind.host=<hs2Host> -Dhive.server2.authentication.kerberos.principal=<hivePrincipal>

Issue Links

• links to: Review Board