[SPARK-30171] Eliminate warnings: part 2

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 3.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: ABHISHEK KUMAR GUPTA
• Created: 09/Dec/19 04:41
• Updated: 15/Jan/20 12:19
• Resolved: 15/Jan/20 12:15

Description

AvroFunctionsSuite.scala
Warning:Warning:line (41)method to_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
val avroDF = df.select(to_avro('id).as("a"), to_avro('str).as("b"))
Warning:Warning:line (41)method to_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
val avroDF = df.select(to_avro('id).as("a"), to_avro('str).as("b"))
Warning:Warning:line (54)method from_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.from_avro' instead.
checkAnswer(avroDF.select(from_avro('a, avroTypeLong), from_avro('b, avroTypeStr)), df)
Warning:Warning:line (54)method from_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.from_avro' instead.
checkAnswer(avroDF.select(from_avro('a, avroTypeLong), from_avro('b, avroTypeStr)), df)
Warning:Warning:line (59)method to_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
val avroStructDF = df.select(to_avro('struct).as("avro"))
Warning:Warning:line (70)method from_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.from_avro' instead.
checkAnswer(avroStructDF.select(from_avro('avro, avroTypeStruct)), df)
Warning:Warning:line (76)method to_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
val avroStructDF = df.select(to_avro('struct).as("avro"))
Warning:Warning:line (118)method to_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.to_avro' instead.
val readBackOne = dfOne.select(to_avro($"array").as("avro"))
Warning:Warning:line (119)method from_avro in package avro is deprecated (since 3.0.0): Please use 'org.apache.spark.sql.avro.functions.from_avro' instead.
.select(from_avro($"avro", avroTypeArrStruct).as("array"))
AvroPartitionReaderFactory.scala
Warning:Warning:line (64)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
if (parsedOptions.ignoreExtension || partitionedFile.filePath.endsWith(".avro")) {

AvroFileFormat.scala
Warning:Warning:line (98)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
if (parsedOptions.ignoreExtension || file.filePath.endsWith(".avro")) {
AvroUtils.scala
Warning:Warning:line (55)value ignoreExtension in class AvroOptions is deprecated (since 3.0): Use the general data source option pathGlobFilter for filtering file names
inferAvroSchemaFromFiles(files, conf, parsedOptions.ignoreExtension,

Issue Links

• relates to: SPARK-30490 Eliminate warnings in Avro datasource