Uploaded image for project: 'Apache Gobblin'
  1. Apache Gobblin
  2. GOBBLIN-700

Unable to run Apache Gobblin Kafka - HDFS USecase

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.14.0
    • Fix Version/s: None
    • Component/s: gobblin-kafka
    • Labels:
      None

      Description

      When i try to run a job to ingest data from kafka and put it on HDFS i get the following error :-

      i am trying the example in this link :- https://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/

      bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
      SLF4J: Class path contains multiple SLF4J bindings.
      SLF4J: Found binding in [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
      SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
      2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48 urls, producing 809 keys and 2849 values
      2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
      Error: Can not create a Path from an empty string
      java.lang.IllegalArgumentException: Can not create a Path from an empty string
      at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
      at org.apache.hadoop.fs.Path.<init>(Path.java:184)
      at org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
      at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
      at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
      at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
      at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
      at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
      at org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
      at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
      [a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
      [a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
      [a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
      SLF4J: Class path contains multiple SLF4J bindings.
      SLF4J: Found binding in [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
      SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
      SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
      2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48 urls, producing 809 keys and 2849 values
      2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
      2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
      Error: Can not create a Path from an empty string
      java.lang.IllegalArgumentException: Can not create a Path from an empty string
      at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
      at org.apache.hadoop.fs.Path.<init>(Path.java:184)
      at org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
      at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
      at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
      at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
      at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
      at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
      at org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
      at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)

        Attachments

          Activity

            People

            • Assignee:
              shirshanka Shirshanka Das
              Reporter:
              ankitgaur Ankit Gaur
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: