Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20383

SparkSQL unsupports to create function with the keyword 'OR REPLACE' and 'IF NOT EXISTS'

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0, 2.0.2, 2.1.0
    • Fix Version/s: 2.3.0
    • Component/s: SQL
    • Labels:
      None
    • Environment:

      spark2.1.0

      Description

      unsupport to create a temporary|permanent function with the key word 'IF NOT EXISTS'.
      I think it is necessary to support this key word in 'create [temporary] fucntion ...' clause,
      For example:
      I hava an application which has three steps as follow :
      1. insert into table t1 as select id from t where ...
      2. create function AA as ... using jar ...
      3. insert into table t2 select AA(id) from t1
      my application run succussfully first time and it will throw an exeception at step 2 when it run again. So, I think it is reasonable and friendly to user application.

        Attachments

          Activity

            People

            • Assignee:
              ouyangxc.zte Xiaochen Ouyang
              Reporter:
              ouyangxc.zte Xiaochen Ouyang
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: