Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17718 Hive on Spark Debugging Improvements
  3. HIVE-19733

RemoteSparkJobStatus#getSparkStageProgress inefficient implementation

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 4.0.0
    • Component/s: Spark
    • Labels:
      None

      Description

      The implementation of RemoteSparkJobStatus#getSparkStageProgress is a bit inefficient. There is one RPC call to get the SparkJobInfo and then for every stage there is another RPC call to get each SparkStageInfo. This could all be done in a single RPC call.

        Attachments

        1. HIVE-19733.3.patch
          9 kB
          Bharathkrishna Guruvayoor Murali
        2. HIVE-19733.2.patch
          10 kB
          Bharathkrishna Guruvayoor Murali
        3. HIVE-19733.1.patch
          6 kB
          Bharathkrishna Guruvayoor Murali

          Issue Links

            Activity

              People

              • Assignee:
                bharos92 Bharathkrishna Guruvayoor Murali
                Reporter:
                stakiar Sahil Takiar
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: