[SPARK-19514] Range is not interruptible

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.2.0
• Component/s: SQL
• Assignee: Ala Luszczak
• Reporter: Ala Luszczak
• Created: 08/Feb/17 13:30
• Updated: 13/Feb/17 16:34
• Resolved: 09/Feb/17 18:07

Description

Currently Range cannot be interrupted.

For example, if you start executing

spark.range(0, A_LOT, 1).crossJoin(spark.range(0, A_LOT, 1)).count()

and then call

DAGScheduler.cancellStage(...)

the execution won't stop.

Issue Links

• links to: [Github] Pull Request #16872 (ala)
• links to: [Github] Pull Request #16914 (ala)