Uploaded image for project: 'Hadoop Distributed Data Store'
  1. Hadoop Distributed Data Store
  2. HDDS-3278

Acceptance test ozonesecure-mr-mapreduce failing

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 0.6.0
    • Fix Version/s: None
    • Component/s: docker
    • Labels:
      None
    • Target Version/s:

      Description

      The acceptance / robot test ozonesecure-mr-mapreduce appears to be failing when running the pi calculation:

      ozonesecure-mr-mapreduce :: Execute MR jobs                                   
      ==============================================================================
      Execute PI calculation                                                | FAIL |
      255 != 0
      ------------------------------------------------------------------------------
      Execute WordCount                                                     | FAIL |
      255 != 0
      ------------------------------------------------------------------------------
      ozonesecure-mr-mapreduce :: Execute MR jobs                           | FAIL |
      2 critical tests, 0 passed, 2 failed
      2 tests total, 0 passed, 2 failed
      

      The error report by the command is:

      <msg timestamp="20200325 15:02:19.186" level="INFO">Running command 'yarn jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar pi 3 3 2&gt;&amp;1'.</msg>
      <msg timestamp="20200325 15:02:20.761" level="INFO">${rc} = 255</msg>
      <msg timestamp="20200325 15:02:20.761" level="INFO">${output} = Number of Maps  = 3
      Samples per Map = 3
      org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "o3fs"
              at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281...</msg>
      <status status="PASS" endtime="20200325 15:02:20.761" starttime="20200325 15:02:19.185"></status>
      </kw>
      <kw name="Log" library="BuiltIn">
      <doc>Logs the given message with the given level.</doc>
      <arguments>
      <arg>${output}</arg>
      </arguments>
      <msg timestamp="20200325 15:02:20.762" level="INFO">Number of Maps  = 3
      Samples per Map = 3
      org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "o3fs"
              at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281)
              at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3301)
              at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
              at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)
              at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227)
              at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:463)
              at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
              at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:522)
              at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:275)
              at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:360)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
              at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:368)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
              at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
              at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
              at org.apache.hadoop.util.RunJar.main(RunJar.java:236)</msg>
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              sodonnell Stephen O'Donnell
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: