[BAHIR-138] Fix sql-cloudant deprecation messages

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: Spark-2.2.0
• Fix Version/s: Spark-2.2.1, Spark-2.3.0
• Component/s: Spark Structured Streaming Connectors
• Labels: warnings
• Assignee: Esteban Laver
• Reporter: Esteban Laver
• Created: 01/Oct/17 16:56
• Updated: 25/Jan/18 04:48
• Resolved: 21/Dec/17 00:32

Description

Deprecation warnings in DefaultSource:

[INFO] --- scala-maven-plugin:3.2.2:compile (scala-compile-first) @ spark-sql-cloudant_2.11 ---
[INFO] Compiling 11 Scala sources to sql-cloudant/target/scala-2.11/classes...
[WARNING] sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala:59: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]         val df = sqlContext.read.json(cloudantRDD)
[WARNING]                                  ^
[WARNING] sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala:115: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]             dataFrame = sqlContext.read.json(cloudantRDD)
[WARNING]                                         ^
[WARNING] sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala:121: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]             sqlContext.read.json(aRDD)
[WARNING]                             ^
[WARNING] sql-cloudant/src/main/scala/org/apache/bahir/cloudant/DefaultSource.scala:152: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]               dataFrame = sqlContext.sparkSession.read.json(globalRDD)
[WARNING]                                                        ^
[WARNING] four warnings found

Deprecation warnings in CloudantStreaming and CloudantStreamingSelector examples:

[INFO] --- scala-maven-plugin:3.2.2:testCompile (scala-test-compile-first) @ spark-sql-cloudant_2.11 ---
[INFO] Compiling 11 Scala sources to sql-cloudant/target/scala-2.11/test-classes...
[WARNING] sql-cloudant/examples/src/main/scala/org/apache/spark/examples/sql/cloudant/CloudantStreaming.scala:46: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]       val changesDataFrame = spark.read.json(rdd)
[WARNING]                                         ^
[WARNING] sql-cloudant/examples/src/main/scala/org/apache/spark/examples/sql/cloudant/CloudantStreaming.scala:67: method registerTempTable in class Dataset is deprecated: Use createOrReplaceTempView(viewName) instead.
[WARNING]           changesDataFrame.registerTempTable("airportcodemapping")
[WARNING]                            ^
[WARNING] sql-cloudant/examples/src/main/scala/org/apache/spark/examples/sql/cloudant/CloudantStreamingSelector.scala:50: method json in class DataFrameReader is deprecated: Use json(Dataset[String]) instead.
[WARNING]       val changesDataFrame = spark.read.json(rdd)
[WARNING]                                         ^
[WARNING] three warnings found

Issue Links

• links to: GitHub Pull Request #59
• links to: GitHub Pull Request #63