Uploaded image for project: 'Sentry'
  1. Sentry
  2. SENTRY-872 Uber jira for HMS HA + Sentry HA redesign
  3. SENTRY-1596

Hive tests failing for sentry-ha-redesign branch

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 2.0.0
    • Component/s: Sentry
    • Labels:
      None

      Description

      I noticed that for recent branches of sentry-ha-redesign hive tests fail with

      [INFO] Sentry Hive Tests ................................. FAILURE [1:05:44.751s]
      [INFO] Sentry HDFS Dist .................................. SKIPPED
      [INFO] Sentry Distribution ............................... SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 1:26:37.089s
      [INFO] Finished at: Tue Jan 17 19:26:21 UTC 2017
      [INFO] Final Memory: 73M/895M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.19.1:test (default-test) on project sentry-tests-hive: There was a timeout or other error in the fork -> [Help 1]
      

      So it isn't a specific test, but apparently tests taking too much time. There is a setting in top-level pom.xml file:

                <plugin>
                  <groupId>org.apache.maven.plugins</groupId>
                  <artifactId>maven-surefire-plugin</artifactId>
                  <version>2.19.1</version>
                  <configuration>
                    <argLine>-Xms256m -Xmx2g -XX:MaxPermSize=256m</argLine>
                    <environmentVariables>
                      <HADOOP_CLIENT_OPTS>-Xmx1500m -Dhive.log.dir=./target/</HADOOP_CLIENT_OPTS>
                    </environmentVariables>
                    <forkCount>2.5C</forkCount>
                    <forkedProcessTimeoutInSeconds>900</forkedProcessTimeoutInSeconds>
                    <redirectTestOutputToFile>true</redirectTestOutputToFile>
                    <rerunFailingTestsCount>3</rerunFailingTestsCount>
                    <reuseForks>false</reuseForks>
                    <systemPropertyVariables>
                      <java.net.preferIPv4Stack>true</java.net.preferIPv4Stack>
                    </systemPropertyVariables>
                    <excludes combine.children="append">
                      <exclude>%regex[org.apache.sentry.tests.e2e.*.class]</exclude>
                      <exclude>%regex[org.apache.sentry.binding.hive.TestURI.class]</exclude>
                      <exclude>%regex[org.apache.sentry.provider.db.service.thrift.*.class]</exclude>
                      <exclude>%regex[org.apache.solr.handler.admin.*.class]</exclude>
                      <exclude>%regex[org.apache.sentry.provider.db.generic.service.thrift.*.class]</exclude>
                      <exclude>%regex[org.apache.sentry.provider.db.generic.tools.*.class]</exclude>
                    </excludes>
                  </configuration>
                </plugin>
      

      So forkedProcessTimeoutInSeconds is set to 900 and tests take ~90 minutes to run which probably causes the problem. I don't know when the problem first appeared, but we can't have successfull test run for sentry-ha-redesign tests now.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                hahao Hao Hao
                Reporter:
                akolb Alex Kolbasov
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: