[HDDS-4548] OM failed to start because trash emptier complains No FileSystem for scheme "ofs"

• Type: Sub-task
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.1.0
• Component/s: Ozone Manager
• Assignee: Sadanand Shenoy
• Reporter: Siyao Meng
• Created: 03/Dec/20 19:59
• Updated: 07/Jan/21 04:11
• Resolved: 07/Jan/21 04:11

Description

Trivial to repro with docker-compose:

1. Add line

CORE-SITE.XML_fs.trash.interval=1

in hadoop-ozone/dist/src/main/compose/ozone/docker-config to enable trash emptier.

2. then start the docker-compose cluster
3. observe that OM failed to start:

2020-12-03 19:55:59,431 [IPC Server listener on 9862] INFO ipc.Server: IPC Server listener on 9862: starting

2020-12-03 19:55:59,625 [Listener at om/9862] ERROR om.OzoneManagerStarter: OM start failed with exception

org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "ofs"

at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281)

at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3301)

at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)

at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)

at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)

at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227)

at org.apache.hadoop.ozone.om.OzoneManager$1.run(OzoneManager.java:1288)

at org.apache.hadoop.ozone.om.OzoneManager$1.run(OzoneManager.java:1285)

at java.base/java.security.AccessController.doPrivileged(Native Method)

at java.base/javax.security.auth.Subject.doAs(Subject.java:423)

at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)

at org.apache.hadoop.security.SecurityUtil.doAsUser(SecurityUtil.java:517)

at org.apache.hadoop.security.SecurityUtil.doAsLoginUser(SecurityUtil.java:498)

at org.apache.hadoop.ozone.om.OzoneManager.startTrashEmptier(OzoneManager.java:1284)

at org.apache.hadoop.ozone.om.OzoneManager.start(OzoneManager.java:1191)

at org.apache.hadoop.ozone.om.OzoneManagerStarter$OMStarterHelper.start(OzoneManagerStarter.java:125)

at org.apache.hadoop.ozone.om.OzoneManagerStarter.startOm(OzoneManagerStarter.java:79)

at org.apache.hadoop.ozone.om.OzoneManagerStarter.call(OzoneManagerStarter.java:67)

at org.apache.hadoop.ozone.om.OzoneManagerStarter.call(OzoneManagerStarter.java:38)

at picocli.CommandLine.executeUserObject(CommandLine.java:1933)

at picocli.CommandLine.access$1100(CommandLine.java:145)

at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2332)

at picocli.CommandLine$RunLast.handle(CommandLine.java:2326)

at picocli.CommandLine$RunLast.handle(CommandLine.java:2291)

at picocli.CommandLine$AbstractParseResultHandler.handleParseResult(CommandLine.java:2152)

at picocli.CommandLine.parseWithHandlers(CommandLine.java:2530)

at picocli.CommandLine.parseWithHandler(CommandLine.java:2465)

at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:96)

at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:87)

at org.apache.hadoop.ozone.om.OzoneManagerStarter.main(OzoneManagerStarter.java:51)

No FileSystem for scheme "ofs"

2020-12-03 19:55:59,635 [shutdown-hook-0] INFO om.OzoneManagerStarter: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down OzoneManager at 83b51d59597e/172.18.0.2

************************************************************/

Issue Links

• Blocked: HDDS-4387 Create a Trash File System that will be used by Trash Emptier