[SPARK-8412] java#KafkaUtils.createDirectStream Java(Pair)RDDs do not implement HasOffsetRanges

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Duplicate
• Affects Version/s: 1.3.0
• Component/s: DStreams
• Assignee: Unassigned
• Reporter: jweinste
• Created: 17/Jun/15 17:36
• Updated: 18/Jun/15 07:36
• Resolved: 18/Jun/15 07:36

Description

// Create direct kafka stream with brokers and topics
final JavaPairInputDStream<String, String> messages = KafkaUtils.createDirectStream(jssc, String.class, String.class, StringDecoder.class,
StringDecoder.class, kafkaParams, topics);

messages.foreachRDD(new Function<JavaPairRDD<String, String>, Void>() {
@Override
public Void call(final JavaPairRDD<String, String> rdd) throws Exception {
if (rdd instanceof HasOffsetRanges) {
//will never happen.

Issue Links

• duplicates: SPARK-8390 Update DirectKafkaWordCount examples to show how offset ranges can be used