Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-3367 Trash Support for Ozone FileSystem
  3. HDDS-4548

OM failed to start because trash emptier complains No FileSystem for scheme "ofs"

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Ozone Manager
    • Labels:
      None

      Description

      Trivial to repro with docker-compose:

      1. Add line

      CORE-SITE.XML_fs.trash.interval=1
      

      in hadoop-ozone/dist/src/main/compose/ozone/docker-config to enable trash emptier.

      2. then start the docker-compose cluster
      3. observe that OM failed to start:

      2020-12-03 19:55:59,431 [IPC Server listener on 9862] INFO ipc.Server: IPC Server listener on 9862: starting
      
      2020-12-03 19:55:59,625 [Listener at om/9862] ERROR om.OzoneManagerStarter: OM start failed with exception
      
      org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme "ofs"
      
      at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3281)
      
      at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3301)
      
      at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
      
      at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)
      
      at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)
      
      at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)
      
      at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227)
      
      at org.apache.hadoop.ozone.om.OzoneManager$1.run(OzoneManager.java:1288)
      
      at org.apache.hadoop.ozone.om.OzoneManager$1.run(OzoneManager.java:1285)
      
      at java.base/java.security.AccessController.doPrivileged(Native Method)
      
      at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
      
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1730)
      
      at org.apache.hadoop.security.SecurityUtil.doAsUser(SecurityUtil.java:517)
      
      at org.apache.hadoop.security.SecurityUtil.doAsLoginUser(SecurityUtil.java:498)
      
      at org.apache.hadoop.ozone.om.OzoneManager.startTrashEmptier(OzoneManager.java:1284)
      
      at org.apache.hadoop.ozone.om.OzoneManager.start(OzoneManager.java:1191)
      
      at org.apache.hadoop.ozone.om.OzoneManagerStarter$OMStarterHelper.start(OzoneManagerStarter.java:125)
      
      at org.apache.hadoop.ozone.om.OzoneManagerStarter.startOm(OzoneManagerStarter.java:79)
      
      at org.apache.hadoop.ozone.om.OzoneManagerStarter.call(OzoneManagerStarter.java:67)
      
      at org.apache.hadoop.ozone.om.OzoneManagerStarter.call(OzoneManagerStarter.java:38)
      
      at picocli.CommandLine.executeUserObject(CommandLine.java:1933)
      
      at picocli.CommandLine.access$1100(CommandLine.java:145)
      
      at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2332)
      
      at picocli.CommandLine$RunLast.handle(CommandLine.java:2326)
      
      at picocli.CommandLine$RunLast.handle(CommandLine.java:2291)
      
      at picocli.CommandLine$AbstractParseResultHandler.handleParseResult(CommandLine.java:2152)
      
      at picocli.CommandLine.parseWithHandlers(CommandLine.java:2530)
      
      at picocli.CommandLine.parseWithHandler(CommandLine.java:2465)
      
      at org.apache.hadoop.hdds.cli.GenericCli.execute(GenericCli.java:96)
      
      at org.apache.hadoop.hdds.cli.GenericCli.run(GenericCli.java:87)
      
      at org.apache.hadoop.ozone.om.OzoneManagerStarter.main(OzoneManagerStarter.java:51)
      
      No FileSystem for scheme "ofs"
      
      2020-12-03 19:55:59,635 [shutdown-hook-0] INFO om.OzoneManagerStarter: SHUTDOWN_MSG:
      
      /************************************************************
      
      SHUTDOWN_MSG: Shutting down OzoneManager at 83b51d59597e/172.18.0.2
      
      ************************************************************/
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                sadanand_shenoy Sadanand Shenoy
                Reporter:
                smeng Siyao Meng
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: