[SPARK-31518] Expose filterByRange in JavaPairRDD

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: Spark Core
• Assignee: Antonin Delpeuch
• Reporter: Antonin Delpeuch
• Created: 22/Apr/20 08:40
• Updated: 23/Apr/20 03:07
• Resolved: 23/Apr/20 03:05

Description

The `filterByRange` method makes it possible to efficiently filter a sorted RDD using bounds on its keys. It prunes out partitions instead of scanning them if a RangePartitioner is available in the RDD.

This method is part of the Scala API, defined in OrderedRDDFunctions, but is not exposed in the Java API as far as I can tell. All other methods defined in OrderedRDDFunctions are exposed in JavaPairRDD, therefore it seems natural to expose `filterByRange` there too.