Uploaded image for project: 'Camel'
  1. Camel
  2. CAMEL-11920

camel-hdfs2 not working in osgi using documented HdfsOsgiHelper

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.20.0
    • Fix Version/s: 2.19.4, 2.20.1, 2.21.0
    • Component/s: camel-hdfs2
    • Labels:
      None
    • Estimated Complexity:
      Unknown

      Description

      Step to reproduce (an osgi environment like karaf or fuse is needed):

      1. Unzip hdfs2-issue.zip to folder HDFS2_ISSUE_ROOT
      2. mvn clean package
      3. Run osgi environment (bin/karaf)
      4. feature:install camel-hdfs2 (adding a feature repo might be needed)
      5. install -s file:HDFS2_ISSUE_ROOT/target/generic-issue-1.jar
      6. See the exception in log:
        2017-08-01 16:38:04,367 | ERROR | nt Dispatcher: 1 | BlueprintCamelContext            | 49 - org.apache.camel.camel-blueprint - 2.20.0.fuse-000052 | Error occurred during starting Camel Context  hdfs2-test
        java.io.IOException: No FileSystem for scheme: hdfs
        	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2644) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2651) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:92) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2687) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2669) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:371) [238:org.apache.servicemix.bundles.hadoop-client:2.7.2.1]
        	at org.apache.camel.component.hdfs2.HdfsInfo.<init>(HdfsInfo.java:36) [226:org.apache.camel.camel-hdfs2:2.20.0.fuse-000052]
        	at org.apache.camel.component.hdfs2.HdfsOutputStream.createOutputStream(HdfsOutputStream.java:49) [226:org.apache.camel.camel-hdfs2:2.20.0.fuse-000052]
        	at org.apache.camel.component.hdfs2.HdfsProducer.setupHdfs(HdfsProducer.java:143) [226:org.apache.camel.camel-hdfs2:2.20.0.fuse-000052]
        	at org.apache.camel.component.hdfs2.HdfsProducer.doStart(HdfsProducer.java:104) [226:org.apache.camel.camel-hdfs2:2.20.0.fuse-000052]
        	at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.util.ServiceHelper.startService(ServiceHelper.java:75) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DeferServiceStartupListener.onCamelContextStarted(DeferServiceStartupListener.java:49) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.safelyStartRouteServices(DefaultCamelContext.java:3723) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.doStartOrResumeRoutes(DefaultCamelContext.java:3502) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.doStartCamel(DefaultCamelContext.java:3357) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.access$000(DefaultCamelContext.java:204) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3116) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext$2.call(DefaultCamelContext.java:3112) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.doWithDefinedClassLoader(DefaultCamelContext.java:3135) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.doStart(DefaultCamelContext.java:3112) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.support.ServiceSupport.start(ServiceSupport.java:61) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.impl.DefaultCamelContext.start(DefaultCamelContext.java:3050) [51:org.apache.camel.camel-core:2.20.0.fuse-000052]
        	at org.apache.camel.blueprint.BlueprintCamelContext.start(BlueprintCamelContext.java:244) [49:org.apache.camel.camel-blueprint:2.20.0.fuse-000052]
        	at org.apache.camel.blueprint.BlueprintCamelContext.maybeStart(BlueprintCamelContext.java:284) [49:org.apache.camel.camel-blueprint:2.20.0.fuse-000052]
        	at org.apache.camel.blueprint.BlueprintCamelContext.blueprintEvent(BlueprintCamelContext.java:177) [49:org.apache.camel.camel-blueprint:2.20.0.fuse-000052]
        	at org.apache.aries.blueprint.container.BlueprintEventDispatcher$4.call(BlueprintEventDispatcher.java:201) [41:org.apache.aries.blueprint.core:1.8.2]
        	at org.apache.aries.blueprint.container.BlueprintEventDispatcher$4.call(BlueprintEventDispatcher.java:199) [41:org.apache.aries.blueprint.core:1.8.2]
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:?]
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:?]
        	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:?]
        	at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:?]
        	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:?]
        	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:?]
        	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:?]
        	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:?]
        	at java.lang.Thread.run(Thread.java:748) [?:?]
        

        Attachments

        1. hdfs2-issue.zip
          43 kB
          Andrea Tarocchi

          Issue Links

            Activity

              People

              • Assignee:
                acosentino Andrea Cosentino
                Reporter:
                valdar Andrea Tarocchi
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: