Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-1537

Add integration with Yarn's Application Timeline Server

    Details

    • Type: New Feature
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: YARN
    • Labels:
      None

      Description

      It would be nice to have Spark integrate with Yarn's Application Timeline Server (see YARN-321, YARN-1530). This would allow users running Spark on Yarn to have a single place to go for all their history needs, and avoid having to manage a separate service (Spark's built-in server).

      At the moment, there's a working version of the ATS in the Hadoop 2.4 branch, although there is still some ongoing work. But the basics are there, and I wouldn't expect them to change (much) at this point.

        Attachments

        1. SPARK-1537.txt
          4 kB
          Zhan Zhang
        2. spark-1573.patch
          38 kB
          Zhan Zhang

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                vanzin Marcelo Vanzin
              • Votes:
                11 Vote for this issue
                Watchers:
                48 Start watching this issue

                Dates

                • Created:
                  Updated: