Uploaded image for project: 'Solr'
  1. Solr
  2. SOLR-9460

Testcase org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation breaks on Windows

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 7.0
    • Component/s: Hadoop Integration
    • Labels:
      None

      Description

      The above test breaks on windows, because it does not find some crazy executables.

      I think it should have the assumption to respect the automatically set sysprop "tests.disableHdfs" (if its related to HDFS) or simply assumeFalse(Constants.WINDOWS).:

      [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
         [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J1\temp\solr.cloud.TestSolrCloudWithSecureImpersonation_357B7FD39643C4D2-001\init-core-data-001
         [junit4]   2> 1213353 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[357B7FD39643C4D2]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
         [junit4]   2> 1213678 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[357B7FD39643C4D2]-worker) [    ] o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
         [junit4]   2> 1213719 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[357B7FD39643C4D2]-worker) [    ] o.a.h.u.Shell Failed to locate the winutils binary in the hadoop binary path
         [junit4]   2> java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
         [junit4]   2> 	at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:356)
         [junit4]   2> 	at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:371)
         [junit4]   2> 	at org.apache.hadoop.util.Shell.<clinit>(Shell.java:364)
         [junit4]   2> 	at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:80)
         [junit4]   2> 	at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:130)
         [junit4]   2> 	at org.apache.hadoop.security.Groups.<init>(Groups.java:94)
         [junit4]   2> 	at org.apache.hadoop.security.Groups.<init>(Groups.java:74)
         [junit4]   2> 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.getUsersFirstGroup(TestSolrCloudWithSecureImpersonation.java:60)
         [junit4]   2> 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.getImpersonatorSettings(TestSolrCloudWithSecureImpersonation.java:86)
         [junit4]   2> 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.startup(TestSolrCloudWithSecureImpersonation.java:99)
         [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
         [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
         [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:498)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
         [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
         [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
         [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
         [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
         [junit4]   2> 1213749 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[357B7FD39643C4D2]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
         [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=21944, maxDocsPerChunk=322, blockSize=9), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=21944, blockSize=9)), sim=ClassicSimilarity, locale=ga, timezone=Asia/Kathmandu
         [junit4]   2> NOTE: Windows 10 10.0 x86/Oracle Corporation 1.8.0_102 (32-bit)/cpus=3,threads=1,free=164468016,total=536870912
         [junit4]   2> NOTE: All tests run in this JVM: [TestQuerySenderListener, QueryResultKeyTest, TestBinaryResponseWriter, ResponseHeaderTest, TestSolrDeletionPolicy2, TestInitQParser, DistributedTermsComponentTest, TestDistribDocBasedVersion, DistributedFacetPivotLongTailTest, TestOnReconnectListenerSupport, ExitableDirectoryReaderTest, SuggesterWFSTTest, TestSolr4Spatial, ChaosMonkeySafeLeaderTest, TestStressUserVersions, WrapperMergePolicyFactoryTest, FileUtilsTest, TestCopyFieldCollectionResource, TestSmileRequest, TestDistribIDF, TestFastOutputStream, NotRequiredUniqueKeyTest, TestNamedUpdateProcessors, RAMDirectoryFactoryTest, TestConfigSetsAPIZkFailure, CollectionsAPIAsyncDistributedZkTest, TestStressRecovery, TestRandomRequestDistribution, BitVectorTest, BasicAuthIntegrationTest, HdfsBasicDistributedZk2Test, HdfsThreadLeakTest, LeaderFailoverAfterPartitionTest, TestRandomFaceting, TestUseDocValuesAsStored2, OutputWriterTest, TestRuleBasedAuthorizationPlugin, FieldAnalysisRequestHandlerTest, UUIDUpdateProcessorFallbackTest, BasicDistributedZk2Test, GraphQueryTest, DateMathParserTest, TestRangeQuery, TestTrie, DirectUpdateHandlerOptimizeTest, TestNumericTerms64, TestSolrIndexConfig, FieldMutatingUpdateProcessorTest, DistanceFunctionTest, CollectionsAPIDistributedZkTest, DocExpirationUpdateProcessorFactoryTest, TestSolrConfigHandlerConcurrent, TestRecoveryHdfs, DeleteLastCustomShardedReplicaTest, TestSerializedLuceneMatchVersion, AnalyticsQueryTest, SolrInfoMBeanTest, TestCustomDocTransformer, RulesTest, TestFiltering, BasicFunctionalityTest, TestAnalyzeInfixSuggestions, CopyFieldTest, DistributedExpandComponentTest, TestBadConfig, CoreAdminRequestStatusTest, CurrencyFieldOpenExchangeTest, TestInfoStreamLogging, TestMaxScoreQueryParser, DeleteStatusTest, SortSpecParsingTest, SpatialRPTFieldTypeTest, TestStressLiveNodes, ForceLeaderTest, DefaultValueUpdateProcessorTest, TestFieldSortValues, TestAuthorizationFramework, DebugComponentTest, BadIndexSchemaTest, ClassificationUpdateProcessorFactoryTest, TestGraphTermsQParserPlugin, UpdateRequestProcessorFactoryTest, TestTrackingShardHandlerFactory, ZkNodePropsTest, TestSubQueryTransformerDistrib, TestCloudPseudoReturnFields, BinaryUpdateRequestHandlerTest, TestSolrCloudWithSecureImpersonation]
         [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=357B7FD39643C4D2 -Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Asia/Kathmandu -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
         [junit4] ERROR   0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
         [junit4]    > Throwable #1: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.NullPointerException
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([357B7FD39643C4D2]:0)
         [junit4]    > 	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2263)
         [junit4]    > 	at com.google.common.cache.LocalCache.get(LocalCache.java:4000)
         [junit4]    > 	at com.google.common.cache.LocalCache.getOrLoad(LocalCache.java:4004)
         [junit4]    > 	at com.google.common.cache.LocalCache$LocalLoadingCache.get(LocalCache.java:4874)
         [junit4]    > 	at org.apache.hadoop.security.Groups.getGroups(Groups.java:182)
         [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.getUsersFirstGroup(TestSolrCloudWithSecureImpersonation.java:64)
         [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.getImpersonatorSettings(TestSolrCloudWithSecureImpersonation.java:86)
         [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.startup(TestSolrCloudWithSecureImpersonation.java:99)
         [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
         [junit4]    > Caused by: java.lang.NullPointerException
         [junit4]    > 	at java.lang.ProcessBuilder.start(ProcessBuilder.java:1012)
         [junit4]    > 	at org.apache.hadoop.util.Shell.runCommand(Shell.java:483)
         [junit4]    > 	at org.apache.hadoop.util.Shell.run(Shell.java:456)
         [junit4]    > 	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
         [junit4]    > 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
         [junit4]    > 	at org.apache.hadoop.util.Shell.execCommand(Shell.java:798)
         [junit4]    > 	at org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getUnixGroups(ShellBasedUnixGroupsMapping.java:84)
         [junit4]    > 	at org.apache.hadoop.security.ShellBasedUnixGroupsMapping.getGroups(ShellBasedUnixGroupsMapping.java:52)
         [junit4]    > 	at org.apache.hadoop.security.JniBasedUnixGroupsMappingWithFallback.getGroups(JniBasedUnixGroupsMappingWithFallback.java:51)
         [junit4]    > 	at org.apache.hadoop.security.Groups$GroupCacheLoader.fetchGroupList(Groups.java:239)
         [junit4]    > 	at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:220)
         [junit4]    > 	at org.apache.hadoop.security.Groups$GroupCacheLoader.load(Groups.java:208)
         [junit4]    > 	at com.google.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3599)
         [junit4]    > 	at com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2379)
         [junit4]    > 	at com.google.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2342)
         [junit4]    > 	at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2257)
         [junit4]    > 	... 31 moreThrowable #2: java.lang.NullPointerException
         [junit4]    > 	at __randomizedtesting.SeedInfo.seed([357B7FD39643C4D2]:0)
         [junit4]    > 	at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation.shutdown(TestSolrCloudWithSecureImpersonation.java:154)
         [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
         [junit4] Completed [245/632 (2!)] on J1 in 0.43s, 0 tests, 2 errors <<< FAILURES!
      

      I think this is related to Noble Paul's recent commits on this test.

        Attachments

          Activity

            People

            • Assignee:
              uschindler Uwe Schindler
              Reporter:
              uschindler Uwe Schindler
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: