Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-7463 DAG visualization improvements
  3. SPARK-7465

DAG visualization: RDD dependencies not always shown

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 1.4.0
    • None
    • Web UI
    • None

    Description

      Currently if the same RDD appears in multiple stages, the arrow will be drawn only for the first occurrence. It may be too much to show the dependency on every single occurrence of the same RDD (common in MLlib and GraphX), but we should at least show them on hover so the user knows where the RDDs are coming from.

      Attachments

        Activity

          People

            andrewor14 Andrew Or
            andrewor14 Andrew Or
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: