Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-20953 Add hash map metrics to aggregate and join
  3. SPARK-21052

Add hash map metrics to join

          Details

          • Type: Sub-task
          • Status: Resolved
          • Priority: Major
          • Resolution: Fixed
          • Affects Version/s: 2.2.0
          • Fix Version/s: 2.3.0
          • Component/s: SQL
          • Labels:
            None

            Description

            We should add avg hash map probe metric to join operator and report it on UI.

              Attachments

                Issue Links

                is related to

                Improvement - An improvement or enhancement to an existing feature or task. SPARK-26316 Because of the perf degradation in TPC-DS, we currently partial revert SPARK-21052：Add hash map metrics to join,

                • Major - Major loss of function.
                • Resolved
                links to

                Pull request #18301 [Github] Pull Request #18301 (viirya)

                Pull request #18480 [Github] Pull Request #18480 (viirya)

                Pull request #23204 [Github] Pull Request #23204 (JkSelf)

                Web Link GitHub Pull Request #23204

                  Activity

                    People

                    • Assignee:
                      viirya Liang-Chi Hsieh
                      Reporter:
                      viirya Liang-Chi Hsieh
                    • Votes:
                      0 Vote for this issue
                      Watchers:
                      4 Start watching this issue

                      Dates

                      • Created:
                        Updated:
                        Resolved: