Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: Spark
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The spark plan generated by SparkPlanGenerator contains info which isn't available in Hive's explain plan, such as RDD caching. Also, the graph is slight different from orignal SparkWork. Thus, it would be nice to visualize the plan as is done for SparkWork.

      Preferrably, the visualization can happen as part of Hive explain extended. If not feasible, we at least can log this at info level.

        Attachments

        1. HIVE-8858.1-spark.patch
          13 kB
          Chinna Rao Lalam
        2. HIVE-8858.2-spark.patch
          12 kB
          Chinna Rao Lalam
        3. HIVE-8858.3-spark.patch
          12 kB
          Chinna Rao Lalam
        4. HIVE-8858.4-spark.patch
          12 kB
          Chinna Rao Lalam
        5. HIVE-8858-spark.patch
          6 kB
          Chinna Rao Lalam

          Activity

            People

            • Assignee:
              chinnalalam Chinna Rao Lalam
              Reporter:
              xuefuz Xuefu Zhang
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: