[SPARK-3446] FutureAction should expose the job ID

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: Spark Core
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 08/Sep/14 20:19
• Updated: 02/Oct/14 02:25
• Resolved: 02/Oct/14 02:25

Description

This is a follow up to SPARK-2636.

The patch for that bug added a jobId method to SimpleFutureAction. The problem is that SimpleFutureAction is not exposed through any existing API; all the AsyncRDDActions methods return just FutureAction. So clients have to restore to casting / isInstanceOf to be able to use that.

Exposing the jobId through FutureAction has extra complications, though, because ComplexFutureAction also extends that class.

Issue Links

• is depended upon by: SPARK-3145 Hive on Spark umbrella
• links to: [Github] Pull Request #2337 (vanzin)