[SPARK-24451] Spark-Streaming-Kafka-1.6.3- KafkaUtils.createStream function uses the old Logging class

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 2.3.0
• Component/s: Build, Spark Core
• Labels: kafka-1.1.0 spark-streaming spark-streaming-kafka

Environment

Spark 2.3.0

Spark Streaming 2.3.0

Kafka 1.1.0

 

• Flags: Patch, Important
• Assignee: Unassigned
• Reporter: Ankit Prakash Gupta
• Created: 01/Jun/18 18:28
• Updated: 27/Jun/18 22:35
• Resolved: 27/Jun/18 22:35

Description

While trying using org.apache.spark.streaming.kafka.KafkaUtils.createStream function to create a stream for consumer, I came across an error "java.lang.NoClassDefFoundError: org/apache/spark/Logging". I checked the API documents and found that the Logging Interface was shifted to "org.apache.spark.internal" package from "org.apache.spark" package.

 

Kindly update the same in the class definitions.