[GOBBLIN-700] Unable to run Apache Gobblin Kafka - HDFS USecase

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.14.0
• Component/s: gobblin-kafka
• Assignee: Shirshanka Das
• Reporter: Ankit Gaur
• Created: 13/Mar/19 05:48
• Updated: 13/Mar/19 19:54

Description

When i try to run a job to ingest data from kafka and put it on HDFS i get the following error :-

i am trying the example in this link :- https://gobblin.readthedocs.io/en/latest/case-studies/Kafka-HDFS-Ingestion/

bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:40:05 INFO Reflections - Reflections took 477 ms to scan 48 urls, producing 809 keys and 2849 values
2019-03-13 01:40:07 WARN NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-03-13 01:40:07 WARN DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)
[a82250@usdenprh119 gobblin-dist]$ vi kafka_mr.job
[a82250@usdenprh119 gobblin-dist]$ hdfs dfs -put -f kafka_mr.job .
[a82250@usdenprh119 gobblin-dist]$ bash bin/gobblin run -jobName kafkaGobble -jobFile kafka_mr.job
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/data2/home-guest/a82250/projects/bom/gobblin-dist/lib/slf4j-log4j12-1.7.21.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2019-03-13 01:42:19 INFO Reflections - Reflections took 455 ms to scan 48 urls, producing 809 keys and 2849 values
2019-03-13 01:42:21 WARN NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2019-03-13 01:42:21 WARN DomainSocketFactory - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
Error: Can not create a Path from an empty string
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:127)
at org.apache.hadoop.fs.Path.<init>(Path.java:184)
at org.apache.gobblin.util.PathUtils.getPathWithoutSchemeAndAuthority(PathUtils.java:68)
at org.apache.gobblin.util.PathUtils.relativizePath(PathUtils.java:47)
at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.computeURI(ImmutableFSJobCatalog.java:267)
at org.apache.gobblin.runtime.job_catalog.ImmutableFSJobCatalog$JobSpecConverter.apply(ImmutableFSJobCatalog.java:279)
at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.runAsync(EmbeddedGobblin.java:416)
at org.apache.gobblin.runtime.embedded.EmbeddedGobblin.run(EmbeddedGobblin.java:387)
at org.apache.gobblin.runtime.cli.CliEmbeddedGobblin.run(CliEmbeddedGobblin.java:101)
at org.apache.gobblin.runtime.cli.GobblinCli.main(GobblinCli.java:43)