[SPARK-16833] [Spark2.0]when creating temporary function,command "add jar" doesn't work unless restart spark

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.0.0
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: marymwu
• Created: 01/Aug/16 09:10
• Updated: 21/May/19 04:33
• Resolved: 21/May/19 04:33

Description

[Spark2.0]when creating temporary function,command "add jar" doesn't work unless restart spark
Steps:
1. add jar /tmp/GeoIP-0.6.8.jar;
2. create temporary function GeoIP2 as 'com.lenovo.lps.device.hive.udf.UDFGeoIP';
3. select GeoIP2('tdy');
Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 527.0 failed 8 times, most recent failure: Lost task 0.7 in stage 527.0 (TID 140171, smokeslave2.avatar.lenovomm.com): java.lang.RuntimeException: Stream '/jars/GeoIP-0.6.8.jar'' was not found.

Note: After restart spark，it works.