Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1678

Hadoop 1 build broken

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: Integration
    • Labels:
      None

      Description

      building for H1 got error below, which blocks build tests for H1

      T E S T S
      -------------------------------------------------------
      Running org.apache.mahout.clustering.TestClusterDumper
      Running org.apache.mahout.clustering.TestClusterEvaluator
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.033 sec - in org.apache.mahout.clustering.TestClusterDumper
      Running org.apache.mahout.clustering.cdbw.TestCDbwEvaluator
      Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.089 sec - in org.apache.mahout.clustering.cdbw.TestCDbwEvaluator
      Running org.apache.mahout.cf.taste.impl.similarity.jdbc.MySQLJDBCInMemoryItemSimilarityTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.701 sec - in org.apache.mahout.cf.taste.impl.similarity.jdbc.MySQLJDBCInMemoryItemSimilarityTest
      Running org.apache.mahout.text.LuceneStorageConfigurationTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.903 sec - in org.apache.mahout.text.LuceneStorageConfigurationTest
      Running org.apache.mahout.text.LuceneSegmentInputSplitTest
      Tests run: 2, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 3.552 sec <<< FAILURE! - in org.apache.mahout.text.LuceneSegmentInputSplitTest
      testGetSegment(org.apache.mahout.text.LuceneSegmentInputSplitTest) Time elapsed: 2.248 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([B6AAF6EC1A001636:33AA49EC475E421B]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputSplit.getSegment(LuceneSegmentInputSplit.java:92)
      at org.apache.mahout.text.LuceneSegmentInputSplitTest.assertSegmentContainsOneDoc(LuceneSegmentInputSplitTest.java:81)
      at org.apache.mahout.text.LuceneSegmentInputSplitTest.testGetSegment(LuceneSegmentInputSplitTest.java:59)

      testGetSegmentNonExistingSegment(org.apache.mahout.text.LuceneSegmentInputSplitTest) Time elapsed: 0.958 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([B6AAF6EC1A001636:F16E11692CC0C088]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputSplit.getSegment(LuceneSegmentInputSplit.java:92)
      at org.apache.mahout.text.LuceneSegmentInputSplitTest.testGetSegmentNonExistingSegment(LuceneSegmentInputSplitTest.java:76)

      Running org.apache.mahout.text.SequenceFilesFromLuceneStorageTest
      Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.904 sec - in org.apache.mahout.clustering.TestClusterEvaluator
      Running org.apache.mahout.text.LuceneSegmentRecordReaderTest
      Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 5.239 sec <<< FAILURE! - in org.apache.mahout.text.LuceneSegmentRecordReaderTest
      testNonExistingIdField(org.apache.mahout.text.LuceneSegmentRecordReaderTest) Time elapsed: 2.588 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([BE4E63CDB556DEFF:25483164126E6A9]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputSplit.getSegment(LuceneSegmentInputSplit.java:92)
      at org.apache.mahout.text.LuceneSegmentRecordReader.initialize(LuceneSegmentRecordReader.java:55)
      at org.apache.mahout.text.LuceneSegmentRecordReaderTest.testNonExistingIdField(LuceneSegmentRecordReaderTest.java:93)

      testNonExistingField(org.apache.mahout.text.LuceneSegmentRecordReaderTest) Time elapsed: 1.188 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([BE4E63CDB556DEFF:4252F6007B6F27B1]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputSplit.getSegment(LuceneSegmentInputSplit.java:92)
      at org.apache.mahout.text.LuceneSegmentRecordReader.initialize(LuceneSegmentRecordReader.java:55)
      at org.apache.mahout.text.LuceneSegmentRecordReaderTest.testNonExistingField(LuceneSegmentRecordReaderTest.java:104)

      testKey(org.apache.mahout.text.LuceneSegmentRecordReaderTest) Time elapsed: 1.126 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([BE4E63CDB556DEFF:822F5B9135C6A9A9]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputSplit.getSegment(LuceneSegmentInputSplit.java:92)
      at org.apache.mahout.text.LuceneSegmentRecordReader.initialize(LuceneSegmentRecordReader.java:55)
      at org.apache.mahout.text.LuceneSegmentRecordReaderTest.testKey(LuceneSegmentRecordReaderTest.java:70)

      Running org.apache.mahout.text.TestSequenceFilesFromDirectory
      Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.242 sec - in org.apache.mahout.text.SequenceFilesFromLuceneStorageTest
      Running org.apache.mahout.text.MailArchivesClusteringAnalyzerTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.436 sec - in org.apache.mahout.text.MailArchivesClusteringAnalyzerTest
      Running org.apache.mahout.text.LuceneSegmentInputFormatTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.957 sec - in org.apache.mahout.text.TestSequenceFilesFromDirectory
      Running org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJobTest
      Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.361 sec <<< FAILURE! - in org.apache.mahout.text.LuceneSegmentInputFormatTest
      testGetSplits(org.apache.mahout.text.LuceneSegmentInputFormatTest) Time elapsed: 2.032 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([AD26F40E79D036CF:1945362A68C7FF82]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputFormat.getSplits(LuceneSegmentInputFormat.java:56)
      at org.apache.mahout.text.LuceneSegmentInputFormatTest.testGetSplits(LuceneSegmentInputFormatTest.java:67)

      Running org.apache.mahout.text.SequenceFilesFromLuceneStorageDriverTest
      Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 3.743 sec <<< FAILURE! - in org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJobTest
      testRun(org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJobTest) Time elapsed: 3.386 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([95EE4C508BDE3567:37AEE7E3C7764FCB]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputFormat.getSplits(LuceneSegmentInputFormat.java:56)
      at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1054)
      at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1071)
      at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
      at org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJob.run(SequenceFilesFromLuceneStorageMRJob.java:60)
      at org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJobTest.testRun(SequenceFilesFromLuceneStorageMRJobTest.java:67)

      Running org.apache.mahout.text.SequenceFilesFromMailArchivesTest
      Tests run: 5, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.454 sec <<< FAILURE! - in org.apache.mahout.text.SequenceFilesFromLuceneStorageDriverTest
      testRunOptionalArguments(org.apache.mahout.text.SequenceFilesFromLuceneStorageDriverTest) Time elapsed: 1.382 sec <<< ERROR!
      java.lang.NoSuchMethodError: org.apache.hadoop.fs.FileSystem.newInstance(Ljava/net/URI;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/hadoop/fs/FileSystem;
      at __randomizedtesting.SeedInfo.seed([D85D7A8B60046745:ADD14D3F8FDEAB51]:0)
      at org.apache.solr.store.hdfs.HdfsDirectory.<init>(HdfsDirectory.java:58)
      at org.apache.mahout.text.LuceneSegmentInputFormat.getSplits(LuceneSegmentInputFormat.java:56)
      at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1054)
      at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1071)
      at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:983)
      at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
      at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
      at org.apache.mahout.text.SequenceFilesFromLuceneStorageMRJob.run(SequenceFilesFromLuceneStorageMRJob.java:60)
      at org.apache.mahout.text.SequenceFilesFromLuceneStorageDriver.run(SequenceFilesFromLuceneStorageDriver.java:118)
      at org.apache.mahout.text.SequenceFilesFromLuceneStorageDriverTest.testRunOptionalArguments(SequenceFilesFromLuceneStorageDriverTest.java:135)

      Running org.apache.mahout.utils.SplitInputTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.956 sec - in org.apache.mahout.text.SequenceFilesFromMailArchivesTest
      Running org.apache.mahout.utils.TestConcatenateVectorsJob
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.167 sec - in org.apache.mahout.utils.TestConcatenateVectorsJob
      Running org.apache.mahout.utils.vectors.VectorHelperTest
      Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.519 sec - in org.apache.mahout.utils.vectors.VectorHelperTest
      Running org.apache.mahout.utils.vectors.arff.DriverTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.784 sec - in org.apache.mahout.utils.vectors.arff.DriverTest
      Running org.apache.mahout.utils.vectors.arff.ARFFVectorIterableTest
      Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.552 sec - in org.apache.mahout.utils.vectors.arff.ARFFVectorIterableTest
      Running org.apache.mahout.utils.vectors.arff.ARFFTypeTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.359 sec - in org.apache.mahout.utils.vectors.arff.ARFFTypeTest
      Running org.apache.mahout.utils.vectors.arff.MapBackedARFFModelTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.386 sec - in org.apache.mahout.utils.vectors.arff.MapBackedARFFModelTest
      Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.17 sec - in org.apache.mahout.utils.SplitInputTest
      Running org.apache.mahout.utils.vectors.lucene.LuceneIterableTest
      Running org.apache.mahout.utils.vectors.lucene.DriverTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.159 sec - in org.apache.mahout.utils.vectors.lucene.LuceneIterableTest
      Running org.apache.mahout.utils.vectors.lucene.CachedTermInfoTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.799 sec - in org.apache.mahout.utils.vectors.lucene.CachedTermInfoTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.135 sec - in org.apache.mahout.utils.vectors.lucene.DriverTest
      Running org.apache.mahout.utils.vectors.io.VectorWriterTest
      Running org.apache.mahout.utils.vectors.csv.CSVVectorIteratorTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.601 sec - in org.apache.mahout.utils.vectors.csv.CSVVectorIteratorTest
      Running org.apache.mahout.utils.nlp.collocations.llr.BloomTokenFilterTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.292 sec - in org.apache.mahout.utils.vectors.io.VectorWriterTest
      Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.523 sec - in org.apache.mahout.utils.nlp.collocations.llr.BloomTokenFilterTest
      Running org.apache.mahout.utils.Bump125Test
      Running org.apache.mahout.utils.regex.RegexUtilsTest
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.373 sec - in org.apache.mahout.utils.Bump125Test
      Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.364 sec - in org.apache.mahout.utils.regex.RegexUtilsTest
      Running org.apache.mahout.utils.regex.RegexMapperTest
      Running org.apache.mahout.utils.email.MailProcessorTest
      Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.574 sec - in org.apache.mahout.utils.email.MailProcessorTest
      Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.202 sec - in org.apache.mahout.utils.regex.RegexMapperTest

      Results :

      Tests in error:
      LuceneSegmentInputSplitTest.testGetSegment:59->assertSegmentContainsOneDoc:81 » NoSuchMethod
      LuceneSegmentInputSplitTest.testGetSegmentNonExistingSegment:76 » NoSuchMethod
      LuceneSegmentRecordReaderTest.testNonExistingIdField:93 » NoSuchMethod org.apa...
      LuceneSegmentRecordReaderTest.testNonExistingField:104 » NoSuchMethod org.apac...
      LuceneSegmentRecordReaderTest.testKey:70 » NoSuchMethod org.apache.hadoop.fs.F...
      LuceneSegmentInputFormatTest.testGetSplits:67 » NoSuchMethod org.apache.hadoop...
      SequenceFilesFromLuceneStorageMRJobTest.testRun:67 » NoSuchMethod org.apache.h...
      SequenceFilesFromLuceneStorageDriverTest.testRunOptionalArguments:135 » NoSuchMethod

      Tests run: 103, Failures: 0, Errors: 8, Skipped: 0

      [INFO] ------------------------------------------------------------------------
      [INFO] Reactor Summary:
      [INFO]
      [INFO] Mahout Build Tools ................................ SUCCESS [7.111s]
      [INFO] Apache Mahout ..................................... SUCCESS [0.098s]
      [INFO] Mahout Math ....................................... SUCCESS [1:28.659s]
      [INFO] Mahout HDFS ....................................... SUCCESS [5.642s]
      [INFO] Mahout Map-Reduce ................................. SUCCESS [13:25.549s]
      [INFO] Mahout Integration ................................ FAILURE [1:55.954s]
      [INFO] Mahout Examples ................................... SKIPPED
      [INFO] Mahout Release Package ............................ SKIPPED
      [INFO] Mahout Math Scala bindings ........................ SKIPPED
      [INFO] Mahout Spark bindings ............................. SKIPPED
      [INFO] Mahout Spark bindings shell ....................... SKIPPED
      [INFO] Mahout H2O backend ................................ SKIPPED
      [INFO] ------------------------------------------------------------------------
      [INFO] BUILD FAILURE
      [INFO] ------------------------------------------------------------------------
      [INFO] Total time: 17:03.890s
      [INFO] Finished at: Wed Apr 08 07:11:34 PDT 2015
      [INFO] Final Memory: 56M/335M
      [INFO] ------------------------------------------------------------------------
      [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project mahout-integration: There are test failures.
      [ERROR]

        Attachments

          Activity

            People

            • Assignee:
              smarthi Suneel Marthi
              Reporter:
              pferrel Pat Ferrel
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:
                Resolved: