[SPARK-30520] Eliminate deprecation warnings for UserDefinedAggregateFunction

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Max Gekk
• Created: 15/Jan/20 13:30
• Updated: 15/Jun/20 21:17

Description

/Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala
    Warning:Warning:line (718)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      val udaf = clazz.getConstructor().newInstance().asInstanceOf[UserDefinedAggregateFunction]
    Warning:Warning:line (719)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      register(name, udaf)
/Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/udaf.scala
    Warning:Warning:line (328)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
    udaf: UserDefinedAggregateFunction,
    Warning:Warning:line (326)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
case class ScalaUDAF(
/Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/scala/org/apache/spark/sql/DataFrameWindowFunctionsSuite.scala
    Warning:Warning:line (363)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
    val udaf = new UserDefinedAggregateFunction {
/Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/java/test/org/apache/spark/sql/MyDoubleSum.java
    Warning:Warning:line (25)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
    Warning:Warning:line (35)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
/Users/maxim/proj/eliminate-expr-info-warnings/sql/core/src/test/java/test/org/apache/spark/sql/MyDoubleAvg.java
    Warning:Warning:line (25)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
    Warning:Warning:line (36)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
/Users/maxim/proj/eliminate-expr-info-warnings/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/AggregationQuerySuite.scala
    Warning:Warning:line (36)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
class ScalaAggregateFunction(schema: StructType) extends UserDefinedAggregateFunction {
    Warning:Warning:line (73)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
class ScalaAggregateFunctionWithoutInputSchema extends UserDefinedAggregateFunction {
    Warning:Warning:line (100)class UserDefinedAggregateFunction in package expressions is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
class LongProductSum extends UserDefinedAggregateFunction {
    Warning:Warning:line (189)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
    spark.udf.register("mydoublesum", new MyDoubleSum)
    Warning:Warning:line (190)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
    spark.udf.register("mydoubleavg", new MyDoubleAvg)
    Warning:Warning:line (191)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
    spark.udf.register("longProductSum", new LongProductSum)
    Warning:Warning:line (943)method register in class UDFRegistration is deprecated (since 3.0.0): Aggregator[IN, BUF, OUT] should now be registered as a UDF via the functions.udaf(agg) method.
      spark.udf.register("noInputSchema", new ScalaAggregateFunctionWithoutInputSchema)
/Users/maxim/proj/eliminate-expr-info-warnings/sql/hive/src/test/java/org/apache/spark/sql/hive/JavaDataFrameSuite.java
    Warning:Warning:line (30)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
    Warning:Warning:line (78)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
    Warning:Warning:line (79)java: org.apache.spark.sql.expressions.UserDefinedAggregateFunction in org.apache.spark.sql.expressions has been deprecated
    Warning:Warning:line (79)java: register(java.lang.String,org.apache.spark.sql.expressions.UserDefinedAggregateFunction) in org.apache.spark.sql.UDFRegistration has been deprecated

Issue Links

• relates to: SPARK-30423 Deprecate UserDefinedAggregateFunction