Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25334

Default SessionCatalog should support UDFs

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 2.3.1
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:

      Description

      SessionCatalog calls registerFunction to add a function to function registry. However, makeFunctionExpression supports only UserDefinedAggregateFunction.

      We should make makeFunctionExpression support UserDefinedFunction, as it's one of functions type.

      Currently we can use persistent functions only with Hive metastore, but "create function" command works also with default SessionCatalog. It sometimes cause user confusion, like in https://stackoverflow.com/questions/52164488/spark-hive-udf-no-handler-for-udaf-analysis-exception/52170519

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              TomaszGaweda Tomasz Gawęda
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: