[SENTRY-1596] Hive tests failing for sentry-ha-redesign branch

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0
• Fix Version/s: 2.0.0
• Component/s: Sentry
• Assignee: Hao Hao
• Reporter: Alex Kolbasov
• Created: 18/Jan/17 02:10
• Updated: 24/Jul/17 14:52
• Resolved: 20/Jan/17 22:30

Description

I noticed that for recent branches of sentry-ha-redesign hive tests fail with

[INFO] Sentry Hive Tests ................................. FAILURE [1:05:44.751s]
[INFO] Sentry HDFS Dist .................................. SKIPPED
[INFO] Sentry Distribution ............................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 1:26:37.089s
[INFO] Finished at: Tue Jan 17 19:26:21 UTC 2017
[INFO] Final Memory: 73M/895M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project sentry-tests-hive: There was a timeout or other error in the fork -> [Help 1]

So it isn't a specific test, but apparently tests taking too much time. There is a setting in top-level pom.xml file:

          <plugin>
            <groupId>org.apache.maven.plugins</groupId>
            <artifactId>maven-surefire-plugin</artifactId>
            <version>2.19.1</version>
            <configuration>
              <argLine>-Xms256m -Xmx2g -XX:MaxPermSize=256m</argLine>
              <environmentVariables>
                <HADOOP_CLIENT_OPTS>-Xmx1500m -Dhive.log.dir=./target/</HADOOP_CLIENT_OPTS>
              </environmentVariables>
              <forkCount>2.5C</forkCount>
              <forkedProcessTimeoutInSeconds>900</forkedProcessTimeoutInSeconds>
              <redirectTestOutputToFile>true</redirectTestOutputToFile>
              <rerunFailingTestsCount>3</rerunFailingTestsCount>
              <reuseForks>false</reuseForks>
              <systemPropertyVariables>
                <java.net.preferIPv4Stack>true</java.net.preferIPv4Stack>
              </systemPropertyVariables>
              <excludes combine.children="append">
                <exclude>%regex[org.apache.sentry.tests.e2e.*.class]</exclude>
                <exclude>%regex[org.apache.sentry.binding.hive.TestURI.class]</exclude>
                <exclude>%regex[org.apache.sentry.provider.db.service.thrift.*.class]</exclude>
                <exclude>%regex[org.apache.solr.handler.admin.*.class]</exclude>
                <exclude>%regex[org.apache.sentry.provider.db.generic.service.thrift.*.class]</exclude>
                <exclude>%regex[org.apache.sentry.provider.db.generic.tools.*.class]</exclude>
              </excludes>
            </configuration>
          </plugin>

So forkedProcessTimeoutInSeconds is set to 900 and tests take ~90 minutes to run which probably causes the problem. I don't know when the problem first appeared, but we can't have successfull test run for sentry-ha-redesign tests now.

Issue Links

• blocks: SENTRY-872 Uber jira for HMS HA + Sentry HA redesign
• is broken by: SENTRY-1499 Add feature flag for using NotifcationLog