Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: Web UI
    • Target Version/s:

      Description

      Hi all,

      I’m working on a feature of the Hive WebUI Query Plan tab that would provide the option to display the query plan as a nice graph (scroll down for screenshots). If you click on one of the graph’s stages, the plan for that stage appears as text below.

      Stages are color-coded if they have a status (Success, Error, Running), and the rest are grayed out. Coloring is based on status already available in the WebUI, under the Stages tab.

      There is an additional option to display stats for MapReduce tasks. This includes the job’s ID, tracking URL (where the logs are found), and mapper and reducer numbers/progress, among other info.

      The library I’m using for the graph is called vis.js (http://visjs.org/). It has an Apache license, and the only necessary file to be included from this library is about 700 KB.

      I tried to keep server-side changes minimal, and graph generation is taken care of by the client. Plans with more than a given number of stages (default: 25) won't be displayed in order to preserve resources.

      I’d love to hear any and all input from the community about this feature: do you think it’s useful, and is there anything important I’m missing?

      Thanks,

      Karen Coppage

      Review request: https://reviews.apache.org/r/61663/
      Any input is welcome!

        Attachments

        1. last_stage_error.png
          114 kB
          Karen Coppage
        2. last_stage_running.png
          114 kB
          Karen Coppage
        3. complete_success.png
          139 kB
          Karen Coppage
        4. graph_with_mapred_stats.png
          253 kB
          Karen Coppage
        5. full_mapred_stats.png
          405 kB
          Karen Coppage
        6. non_mapred_task_selected.png
          176 kB
          Karen Coppage
        7. HIVE-17300.patch
          690 kB
          Karen Coppage
        8. HIVE-17300.3.patch
          688 kB
          Karen Coppage
        9. HIVE-17300.4.patch
          690 kB
          Peter Vary
        10. HIVE-17300.5.patch
          690 kB
          Peter Vary
        11. HIVE-17300.6.patch
          692 kB
          Karen Coppage
        12. HIVE-17300.7.patch
          696 kB
          Karen Coppage
        13. HIVE-17300.7.patch
          696 kB
          Karen Coppage
        14. HIVE-17300.8.patch
          696 kB
          Karen Coppage
        15. HIVE-17300.8.patch
          696 kB
          Karen Coppage
        16. HIVE-17300.8.patch
          696 kB
          Karen Coppage
        17. HIVE-17300.8.patch
          696 kB
          Karen Coppage
        18. HIVE-17300.9.patch
          698 kB
          Karen Coppage
        19. HIVE-17300.10.patch
          700 kB
          Karen Coppage
        20. HIVE-17300.10.patch
          700 kB
          Karen Coppage
        21. HIVE-17300.10.patch
          700 kB
          Karen Coppage

          Issue Links

            Activity

              People

              • Assignee:
                klcopp Karen Coppage
                Reporter:
                klcopp Karen Coppage
              • Votes:
                0 Vote for this issue
                Watchers:
                16 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: