[HIVE-11920] ADD JAR failing with URL schemes other than file/ivy/hdfs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 1.3.0, 2.0.0
• Assignee: Jason Dere
• Reporter: Jason Dere
• Created: 22/Sep/15 20:39
• Updated: 16/Feb/16 23:50
• Resolved: 30/Sep/15 18:45

Description

Example stack trace below. It looks like this was introduced by HIVE-9664.

015-09-16 19:53:16,502 ERROR [main]: SessionState (SessionState.java:printError(960)) - invalid url: wasb:///tmp/hive-udfs-0.1.jar, expecting ( file | hdfs | ivy)  as url scheme.
java.lang.RuntimeException: invalid url: wasb:///tmp/hive-udfs-0.1.jar, expecting ( file | hdfs | ivy)  as url scheme.
        at org.apache.hadoop.hive.ql.session.SessionState.getURLType(SessionState.java:1230)
        at org.apache.hadoop.hive.ql.session.SessionState.resolveAndDownload(SessionState.java:1237)
        at org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1163)
        at org.apache.hadoop.hive.ql.session.SessionState.add_resources(SessionState.java:1149)
        at org.apache.hadoop.hive.ql.exec.FunctionTask.addFunctionResources(FunctionTask.java:301)
        at org.apache.hadoop.hive.ql.exec.Registry.registerToSessionRegistry(Registry.java:453)
        at org.apache.hadoop.hive.ql.exec.Registry.registerPermanentFunction(Registry.java:200)
        at org.apache.hadoop.hive.ql.exec.FunctionRegistry.registerPermanentFunction(FunctionRegistry.java:1495)
        at org.apache.hadoop.hive.ql.exec.FunctionTask.createPermanentFunction(FunctionTask.java:136)
        at org.apache.hadoop.hive.ql.exec.FunctionTask.execute(FunctionTask.java:75)
        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:160)
        at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:89)
        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1655)
        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1414)
        at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1195)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1059)
        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1049)
        at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:213)
        at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:165)
        at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:376)
        at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:736)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:136)

Issue Links

• duplicates: HIVE-11850 On Windows, creating udf function using wasb fail throwing java.lang.RuntimeException: invalid url: wasb:///... expecting ( file | hdfs | ivy) as url scheme.
• is related to: HIVE-9664 Hive "add jar" command should be able to download and add jars from a repository