Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Won't Fix
-
1.5.1
-
None
-
None
-
Hadoop 2.6+
Description
Add an extension service (using SPARK-11314) to subscribe to Spark lifecycle events, batch them and forward them to the YARN Application Timeline Service. This data can then be retrieved by a new back end for the Spark History Service, and by other analytics tools.