[HDDS-3278] Acceptance test ozonesecure-mr-mapreduce failing

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.0.0
• Component/s: docker
• Target Version/s: 1.0.0
• Assignee: Unassigned
• Reporter: Stephen O'Donnell
• Created: 25/Mar/20 15:12
• Updated: 25/Mar/20 16:00
• Resolved: 25/Mar/20 16:00

Description

The acceptance / robot test ozonesecure-mr-mapreduce appears to be failing when running the pi calculation:

ozonesecure-mr-mapreduce :: Execute MR jobs                                   
==============================================================================
Execute PI calculation                                                | FAIL |
255 != 0
------------------------------------------------------------------------------
Execute WordCount                                                     | FAIL |
255 != 0
------------------------------------------------------------------------------
ozonesecure-mr-mapreduce :: Execute MR jobs                           | FAIL |
2 critical tests, 0 passed, 2 failed
2 tests total, 0 passed, 2 failed

The error report by the command is:

<msg timestamp="20200325 15:02:19.186" level="INFO">Running command 'yarn jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.2.0.jar pi 3 3 2&gt;&amp;1'.</msg>
<msg timestamp="20200325 15:02:20.761" level="INFO">${rc} = 255</msg>
<msg timestamp="20200325 15:02:20.761" level="INFO">${output} = Number of Maps  = 3
Samples per Map = 3
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "o3fs"
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281...</msg>
<status status="PASS" endtime="20200325 15:02:20.761" starttime="20200325 15:02:19.185"></status>
</kw>
<kw name="Log" library="BuiltIn">
<doc>Logs the given message with the given level.</doc>
<arguments>
<arg>${output}</arg>
</arguments>
<msg timestamp="20200325 15:02:20.762" level="INFO">Number of Maps  = 3
Samples per Map = 3
org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "o3fs"
        at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281)
        at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3301)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
        at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:463)
        at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
        at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:522)
        at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:275)
        at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:360)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:368)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:236)</msg>