[SPARK-19696] Wrong Documentation for Java Word Count Example

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.1.0
• Component/s: Documentation
• Assignee: Sean R. Owen
• Reporter: gaurav gupta
• Created: 22/Feb/17 04:54
• Updated: 22/Feb/17 13:53
• Resolved: 22/Feb/17 13:53

Description

Java Word Count example of http://spark.apache.org/examples.html page is defined incorrectly

'''
JavaRDD<String> textFile = sc.textFile("hdfs://...");
JavaRDD<String> words = textFile.flatMap(s -> Arrays.asList(s.split(" ")).iterator())
.mapToPair(word -> new Tuple2<>(word, 1))
.reduceByKey((a, b) -> a + b);
counts.saveAsTextFile("hdfs://...");
''

It should be

'''
JavaRDD<String> textFile = sc.textFile("hdfs://...");
JavaPairRDD<String, Integer> counts = textFile.flatMap(s -> Arrays.asList(s.split(" ")).iterator())
.mapToPair(word -> new Tuple2<>(word, 1))
.reduceByKey((a, b) -> a + b);
counts.saveAsTextFile("hdfs://...");
''''